Research
My research examines how artificial-intelligence systems can support complex decision-making while remaining transparent, robust, fair and operationally useful. The work sits at the intersection of AI, Information Systems, data analytics and human-centred computing.
Explainable, trustworthy and fair AI
I work on methods for evaluating and improving explanations produced by machine-learning systems. This includes neighbourhood-based XAI, sufficiency and necessity, explanation utility, fairness evaluation, bias detection and the design of interpretable decision-support workflows. A central question is not simply whether an explanation can be generated, but whether it is useful for the specific decision or explanandum being addressed. This work is currently being extended to breast-cancer and multi-omics AI through the XFAIR-MED project (see Ongoing research projects).
Generative AI and model evaluation
A second strand examines the quality, diversity and reliability of generative models. My work has considered mode collapse, adaptive image normalisation, synthetic biomedical data, evaluation metrics and the downstream effect of generated data on classification. More broadly, I am interested in how generative AI can be evaluated and governed when it is integrated into organisational and expert workflows.
Workflow analytics and organisational AI
I am increasingly focused on AI-driven workflow analytics, data-driven decision support and the organisational consequences of AI adoption. This includes modelling how information moves through socio-technical systems, how AI changes decision processes, and how transparent AI can support digital transformation and the future of work.
Complex systems and information-theoretic modelling
My work on complex adaptive systems uses multimodal and psychophysiological data to study dynamic behaviour and emergent patterns. I am also interested in information-theoretic approaches to modelling and optimising data-intensive processes, particularly where conventional linear descriptions fail to capture system behaviour.
Biomedical, clinical and psychophysiological AI
Healthcare remains an important application domain. My work spans biomedical image analysis, physiological-signal analysis, ECG quality assessment, clinical decision support, affective computing, fairness and reproducible machine-learning pipelines. These applications provide demanding test cases for trustworthy AI because decisions must be traceable and data quality, bias and uncertainty have direct practical consequences.
Ongoing research projects
XFAIR-MED: Explainable Fairness Audit and Interoperability in Medical AI
High overall accuracy does not mean a clinical AI model is reliable for every patient group. XFAIR-MED is developing an open-source, model-agnostic audit framework for breast-cancer AI. It checks whether a model’s evidence holds up across demographic, clinical and molecular subgroups, including multi-omics strata such as receptor status and tumour mutations. The audit works at three levels: the data (are subgroups adequately represented and comparable?), the model (are performance and errors shared evenly?) and the explanation (do attributions stay consistent and stable across groups?). These are summarised in the Explainable Compound Fairness Score (XCFS), which is always reported alongside its components so that each warning can be traced to its source. A leakage-safe design keeps the markers that define a subgroup out of the model’s predictors. Findings are treated as signals for expert investigation, not as automatic evidence of unfairness. The project extends our earlier FAIR-MED framework and is aligned with the transparency and human-oversight requirements of the EU AI Act.
- Fellow: Dr Katsiaryna Bahamazava, ROSETTA Postdoctoral Fellow, University of Limerick
- Supervision: Dr Katie Crowley (University of Limerick; Lero) and Dr Ruairí O’Reilly (MTU; Lero)
- Funding: ROSETTA MSCA COFUND (Horizon Europe, grant agreement No. 101126578), coordinated by the University of Galway, with co-funding from Lero, the Research Ireland Centre for Software
- Duration: 11 May 2026 – 10 May 2028
- Related publication: Bahamazava, K. & O’Reilly, R. (2026). FAIR-MED: Bias Detection and Fairness Evaluation in Healthcare Focused XAI. xAI 2025, CCIS 2576, pp. 380–401. https://doi.org/10.1007/978-3-032-08317-3_18
This project has received funding from the European Union’s Horizon Europe research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 101126578.
Research directions for collaboration
Current topics of interest include:
- AI-driven workflow analytics for organisational and socio-technical systems
- Information-theoretic approaches to modelling and optimising data-intensive processes
- Complex-systems modelling and simulation of organisational decision environments
- Explainable, trustworthy and fair AI for workflow-based decision support
- Distributed and open-source AI frameworks for scalable analytics
Research affiliations
I am affiliated with Lero, ADAPT, and the Riomh research group at MTU. I also contribute to national and international research communities through conference organisation, programme committees, reviewing and postgraduate supervision.
