Study OAS ·
India's Data Governance Crisis
What’s the News?
- A recent analysis has brought into sharp focus the crisis of data governance and data standardisation in India, highlighting how fragmented and non-standardised government databases are causing policy inefficiencies, significant fiscal leakages, and poor interoperability across ministries.
- The findings underscore that despite generating massive volumes of data, the lack of a common "grammar" for data is forcing Parliamentarians to ask basic questions (e.g., how many schools have functional toilets) because standardised, machine-readable public data is unavailable.
- The discourse has renewed attention on the proposed India Data Management Office (IDMO) under the National Data Governance Framework Policy (NDGFP) as the potential keystone for reform.
The Data Governance Crisis: Anatomy of the Problem
- Lack of Interoperability: Ministries and departments operate in data silos with no shared standards for common indicators. A NITI Aayog vision document noted that even basic attributes like time periods and regional definitions are inconsistent across departments.
- Duplication and Ghost Beneficiaries: Welfare databases often list the same individual multiple times due to a lack of unified schemas. This leads to fiscal leakages that inflate government spending by 4%–7% annually.
- Conflicting Official Estimates: In the health sector, childhood tuberculosis cases are recorded separately in the Health Management Information System (HMIS), disease surveillance networks, and immunisation registries, often resulting in the same patient being counted multiple times.
- Outdated Methodologies and Global Rankings: India’s performance in international indices suffers due to missing or outdated data. In the Global Innovation Index 2024, India had missing data for two indicators and outdated figures for eight others, with several relying on data over a year old.
- Accountability Gaps: A large share of questions asked during the 17th Lok Sabha (2019–24) sought basic administrative facts that should ideally exist in the public domain in a standardised, accessible format, reflecting weak public data infrastructure and transparency.
Impact and Economic Costs
- The Organisation for Economic Co‑operation and Development (OECD) estimates that improving public‑sector data availability and sharing could add 1.5% to India’s GDP, which rises to 2.5% if private‑sector data is included.
- Fiscal clean‑up exercises have demonstrated the scale of potential savings:
- Deleting 17.1 million ineligible names from the Pradhan Mantri Kisan Samman Nidhi (PM‑KISAN) scheme was expected to save ₹90 billion in FY2024.
- Removing 35 million bogus LPG connections could save ₹210 billion over two years.
- Eliminating 16 million fake ration cards may save around ₹100 billion annually.
- Beyond direct fiscal costs, poor data governance leads to uncertain decision‑making, with policymakers often disregarding conflicting data in favour of anecdote or political expediency, and stifles innovation as startups and researchers lose out when high‑quality public data is unavailable.
Government Initiatives
- National Data Governance Framework Policy (NDGFP): A draft policy released by the Ministry of Electronics and Information Technology (MeitY) aimed at transforming the data ecosystem, ensuring non‑personal data is accessible for research and innovation while safeguarding privacy.
- India Data Management Office (IDMO): Proposed as the central body under the NDGFP to develop and enforce common rules, standards, guidelines, and protocols for data across all Ministries and States. It would be set up under the Digital India Corporation and is expected to resolve inter‑ministerial methodological disputes and audit compliance.
- National Data and Analytics Platform (NDAP): A NITI Aayog initiative to make government datasets user‑friendly, interoperable, and easy to analyse.
- Data Governance Quality Index (DGQI): A tool developed by NITI Aayog to assess the data readiness and governance quality of various administrative Ministries and Departments.
- Digital Personal Data Protection (DPDP) Act, 2023: Provides the legal framework empowering citizens over their personal data, complementing the NDGFP’s focus on non‑personal data.
Global Best Practices
- Estonia’s X‑Road: A decentralised, interoperable data‑sharing layer that connects public and private sector databases, enabling seamless and secure digital governance.
- Singapore’s Smart Nation Initiative: Integrates data systems across urban planning, health, and transport to improve public service delivery and governance.
- United Kingdom’s Open Data Framework: Promotes standardised, machine‑readable, and publicly accessible government datasets to enhance transparency and innovation.
- European Union’s Data Governance Framework: Harmonises data‑sharing standards and rules across member states to ensure consistency and comparability.
Additional Info
- Data Standardisation in Governance: Refers to the process of collecting, storing, processing, and presenting information in a uniform format across institutions, ensuring common definitions, classification systems, and reporting methodologies.
- Related Constitutional/Policy Context:
- Data Governance: A subject that cuts across the Union List, State List, and Concurrent List, with IT and personal data protection under the Union List while public health and agriculture (key data domains) are in the State List.
- Right to Information (RTI) Act, 2005: Provides a legal basis for proactive disclosure of government data, though its effectiveness is undermined when data is not standardised or machine‑readable.
- National Data Sharing and Accessibility Policy (NDSAP), 2012: The earlier policy framework for open government data, now being subsumed under the NDGFP.
- Key Stakeholders & Organisations:
- Ministry of Electronics and Information Technology (MeitY): Nodal ministry for the NDGFP and IDMO.
- NITI Aayog: Drives the NDAP and DGQI.
- Ministry of Statistics and Programme Implementation (MoSPI): Responsible for statistical standards, conducting large‑scale surveys, and coordinating between statistical agencies.
- Digital India Corporation (DIC): The proposed hosting body for the IDMO.
- Data Generation vs. Usability: India generates massive volumes of data—with over 1.4 billion mobile subscribers and the world’s largest biometric ID system (Aadhaar)—but ranks low in global data usability indices due to the lack of standardisation and interoperability.