Addressing the impact of artificial intelligence, cyberviolence, and deepfakes on equality, democracy and inclusive societies

The rule of law, respect for human rights and democracy are foundational values of the EU laid down in Article 2 of the Treaty on European Union. These values provide the Union with principled orientations to meet the inevitable geopolitical economic, social and demographic changes that could not be foreseen at the time the Treaties were drafted. This includes how the digital transformation would affect how the debate and political processes would be shaped.

Democracy is cultural practice as much as it is a political system. It is a key strength of European societies, helping ensure respect for equality, the rule of law, fundamental rights and liberty. Actors with anti-democratic tendencies attack democracies and their institutions because democracy is a safeguard against them[[The 2025 report of the V-Dem Institute (“25 years of Autocratization-Democracy Trumped?”) confirms the appalling signs, indicators and tendencies captured over previous years of measurement: “The trend of the ‘third wave of autocratization’ is deepening and spreading. That includes weakening of democracy in some established liberal democracies, breakdown of democracy in countries that were democratic for most of the 21st century, as well as deepening of autocracy in already autocratic states […] The global democratic decline deepens, regardless of how we slice the data and whichever measure we use” (pp. 9 and 10)]]. Even traditionally well-functioning democracies face many challenges, which means that they also continuously need to adapt as conditions change. Social sciences and humanities (SSH) research plays a crucial role in understanding current challenges and threats and mapping future pathways for innovative solutions. Building on historical, cultural, social, legal and philosophical perspectives, research will foster the further development of democracy with a view to enhancing citizen participation and inclusive policymaking, promoting equality and inclusiveness, addressing the impact of AI and the digital transformation of democracy. It will also reinforce democratic resilience and civic preparedness, and preserve the role of free, independent and plural media as key tenets of democracy, among other objectives.

Expected impact:

Proposals for topics under this destination should set out a credible pathway to contributing to the following expected impact of the Horizon Europe Strategic Plan:

• Reinvigorating democratic governance by improving the independence, accountability, transparency, effectiveness and trustworthiness of institutions and policies based on rule of law, and through the expansion of active and inclusive citizens’ participation and engagement empowered by the safeguarding of fundamental rights.

The aim of the research investment supporting this impact is to develop a robust evidence base that can inform the establishment of effective, relevant and sensible policies, which bolster the resilience of democratic systems and protect them from threats. At the same time, it seeks to foster critical thinking while also reinforcing citizens’ trust in democracy, its institutions, and the sense of political participation in its widest possible sense.

The destination seeks synergies with other relevant EU programmes, in particular for the uptake of research results and innovative solutions developed under Horizon Europe. Interaction – among others – with the following programmes is encouraged: Digital Europe (DIGITAL), Technical Support Instrument, CERV (Citizens, Equality, Rights and Values), Erasmus+, ESF+ and Global Europe: Neighbourhood, Development and International Cooperation Instrument.

Applicants are encouraged to consider, where relevant, the services offered by the current and future EU-funded European Research Infrastructures, particularly those in the social sciences and humanities domain^[1]. Where applicable, proposals should leverage the data and services available through European Research Infrastructures federated under the European Open Science Cloud, as well as data from relevant Data Spaces.

As the destination aims directly at citizen engagement and at producing lasting change, it is of particular importance that the research and innovation actions promote the highest standards of transparency and openness. Particular efforts should be made to ensure that the data produced in the context of this destination is FAIR (Findable, Accessible, Interoperable and Re-usable). When applicable, it is encouraged to open up the process, criteria, methodologies and data to civil society in the course of the research.

To maximise the impacts of R&I under this Destination in line with EU priorities, international cooperation is encouraged whenever relevant in the proposed topics.

[1] For a full list see https://ri-portfolio.esfri.eu/ri-portfolio/table. In the social sciences domain, see for example: CESSDA - Consortium of European Social Science Data Archives (https://www.cessda.eu/), ESS – European Social Survey (https://www.europeansocialsurvey.org/), SHARE - Survey of Health, Ageing and Retirement in Europe (https://www.share-eric.eu/) or the European Holocaust Research Infrastructure (https://ehri-project.eu/)

Expected Outcome:

Projects should contribute to all of the following expected outcomes:

• Enhanced understanding of the impact of AI-driven technologies, including AI-generated deepfakes and automated content generation on equality, political participation, democratic processes, public trust, and social cohesion, with evidence-based insights into their role in mitigating or exacerbating disparities.
• Uptake of evidence-based policy frameworks for responsible, trustworthy, and transparent AI governance, integrating ethical, legal, and societal considerations to safeguard fundamental rights, mitigate risks of disinformation, and ensure fair and safe AI deployment, in line with the obligations set out in the EU Regulation on artificial intelligence^[1].
• Increased public awareness and media literacy to empower citizens to identify and critically assess disinformation, use of deepfakes for malicious purpose, and online harm, alongside the uptake of evidence-based tools for preventing, detecting, and mitigating these harms.
• Strengthened capacity of academic institutions to conduct societally relevant AI research and drive the development of trustworthy, ethical AI models, enabled by increased academia-industry collaboration and better access to e.g., computing infrastructure, high-quality datasets, collaborative tools, and funding.

Scope:

The rapid development and deployment of AI technologies, along with their malicious use such as the creation of artificially generated and manipulated content,, profoundly impacts democracy, equality, social inclusion, and knowledge production, and contributes to the rise of cyberviolence. Although AI can offer many opportunities, its misuse can facilitate/amplify inequalities and power imbalances, spread misinformation and cyberviolence against women, children and minorities, concentrate data control, and undermine democratic processes. Hence, this topic addresses both the malicious use of AI (e.g. AI-generated disinformation, deepfakes, cyberviolence) and its unintentional societal consequences (e.g. algorithmic opacity, amplification of bias).

AI’s role in media influence and public trust demands urgent attention, as the rise of AI-generated or manipulated content, including deepfakes, threatens democratic processes and epistemic rights. A key area of concern is how AI and artificially generated content is impacting cyberviolence, and the effect it has on individuals or groups who distrust democracy, particularly where this distrust intersects with far-left and far-right populism and foreign interference.

Proposals should explore how AI-driven technologies and their use may either exacerbate or mitigate^[2] inequalities and discriminations based on sex, gender, sexual orientation, racial or ethnic background, religion or belief, age, and disability, particularly in access to information, decision-making, and representation. A critical analysis is needed of how data - often reflecting existing social biases - can reinforce or challenge dominant social structures and safety, and how such technologies shape public perceptions and knowledge production.

The research should also explore the risks these technologies pose to democratic integrity, particularly through the manipulation of public opinion, electoral processes, and governance systems. Deepfakes and AI-generated misinformation and disinformation can distort facts, spread false narratives, and undermine public trust. Addressing these concerns requires a comprehensive understanding of how AI may be (mis)used to shape political campaigns, media narratives, public engagement, and the spread and dissemination of (gendered) disinformation. Proposals are encouraged to examine how AI-generated content across media, including entertainment media, influence public opinion, social narratives, gender stereotypes and norms, and civic engagement.

Furthermore, proposals should look into how cyberviolence, including online harassment, cyberbullying, threats, and gender-based violence, is exacerbated by sharing manipulated content like deepfakes, deep nudes and AI-driven sextortion on online platforms through manipulated content like deepfakes, deep nudes and AI-driven sextortion. Research should identify how AI may be used to amplify and upscale harm, what the nature of the AI-powered output is, and which groups are disproportionately affected by it, looking particularly at women and minorities, and explore interventions to prevent and mitigate these risks. This includes analysing not only the unintended reproduction of cyberviolence through biased outputs, but also the ways in which AI-powered platforms may be misused by users to generate and/or spread harmful, discriminatory or violent content. A comprehensive assessment of unregulated AI-induced risks of sexual exploitation, violence, and gender-based harm is largely missing for effective regulation, oversight, and prosecution. A multidisciplinary review is needed to evaluate AI-driven risks exposing children, young people, women, older persons and LGBTIQ people to such violence online and offline.

Proposals should research on policy and concrete practices that can effectively address the challenges posed by AI technologies, taking into consideration the EU Regulation on artificial intelligence and subsequent guidance being developed to support its implementation. Proposals should identify best practices and regulatory measures to ensure the ethical deployment of AI and AI literacy while safeguarding equality and democratic integrity. A key aspect of this research is recognising AI’s growing role in shaping policy and judicial decisions. While its integration can improve efficiencies, concerns about bias and fairness persist. Proposals are encouraged to explore AI’s influence on legal and policy outcomes, including unintended consequences.

Additionally, proposals should consider AI’s use and impact on young people. Although AI is not specifically designed for minors, youth are among its most active users. Biases within AI-generated or manipulated content, particularly related to sex gender, sexual orientation, ethnic and racial background, can shape young users’ perceptions, perpetuate stereotypes, affect engagement and mental and physical well-being. Research should investigate how AI systems influence these aspects, and the opportunities and risks associated, including the potential psychological effects of exposure to biased or harmful content.

A key focus should be interdisciplinary research on AI’s role in societal resilience, countering misinformation and disinformation, enhancing civic engagement, and supporting marginalised communities. Proposals should explore inclusive and innovative tools and methodologies for detecting and mitigating deepfakes, disinformation, and cyberviolence facilitated through AI, designed for broad adoption by policymakers, technology developers, media organisations, and the general public.

Effectively addressing these multifaceted challenges demands to combine data-driven analysis, drawing on expertise from a wide range of fields, including both academic disciplines (e.g., computer science, and SSH disciplines such as communication and media sciences, ethics, law, political science, sociology, psychology, and gender studies) and the applied perspectives of those involved in shaping and steering AI technologies in practice.

This research should contribute to the EU’s broader AI strategy, supporting the implementation of the Artificial Intelligence Act and aligning with the EU’s Political Guidelines for 2024-2029. This research should also contribute to the implementation of other EU legislative frameworks, such as the Directive on combating violence against women and domestic violence, that criminalises various cyberviolence offences, including malicious deepfakes, and the Digital Services Act, which addresses illegal content online, including false or manipulated information inciting hate or discrimination. It should also inform global discussions on ethical AI governance and responsible innovation.

Proposals are encouraged to identify other relevant EU-funded projects, and to explore potential collaboration opportunities with them.

The projects selected for funding are encouraged to collaborate with the JRC to seek synergies with its work on innovations in public governance^[3].

[1] Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence and amending Regulations (EC) No 300/2008, (EU) No 167/2013, (EU) No 168/2013, (EU) 2018/858, (EU) 2018/1139 and (EU) 2019/2144 and Directives 2014/90/EU, (EU) 2016/797 and (EU) 2020/1828 (Artificial Intelligence Act).

[2] Including how trustworthy and human-centric AI can be leveraged to support content moderation, fact-checking, and online monitoring.

[3] https://joint-research-centre.ec.europa.eu/projects-and-activities/innovations-public-governance_en