From 7b300b90407d11b65af9ba2653b05c322fd651c5 Mon Sep 17 00:00:00 2001 From: Giacomo Peru Date: Fri, 15 May 2026 15:10:19 +0100 Subject: [PATCH 1/2] Fill in TF2 minutes for 20 April 2026 Co-Authored-By: Claude Sonnet 4.6 (1M context) --- meetings/tf2-rolling-notes.md | 64 ++++++++++++++++++----------------- 1 file changed, 33 insertions(+), 31 deletions(-) diff --git a/meetings/tf2-rolling-notes.md b/meetings/tf2-rolling-notes.md index 96d50f8..6a7be5c 100644 --- a/meetings/tf2-rolling-notes.md +++ b/meetings/tf2-rolling-notes.md @@ -2,57 +2,59 @@ Repository: -# TF2 Meeting Agenda — 20 April 2026 +# TF2 Meeting Minutes — 20 April 2026 **Date:** Monday, 20 April 2026 **Time:** 11:00 UK / 12:00 CET **Location:** -**Attending:** +**Attending:** Giacomo Peru, Daniel Garijo, Faruk Diblen, Shoaib Sufi (late), Thomas Vuillaume, Hugo Bacard (CERN, joined ~47 min), Senem Otles (joined near end) -**Apologies:** +**Apologies:** Michael Sparks -## Agenda items +## A. Actions from 23 March -### Outstanding actions from 23 March +- **Faruk / citation files:** Org-level GH Actions workflow not feasible; instead went through repos individually, raised PRs for missing files. Another review round pending. RF citation file discussed — whether CITATION.cff applies to a document rather than software is unresolved; left open. +- **Giacomo / AI-EVERSE repo:** Done ✅ +- **Giacomo / GitHub issues + Mattermost post:** Done ✅ +- **Shoaib / audience statement:** Assigned at this meeting (see below). +- **Michael / definitions + AI draft:** Absent; no update. -- Faruk — set up org-level GitHub Actions workflow to validate all EVERSE citation files across EVERSE-ResearchSoftware; raise a PR per repo (cffinit suggested as validation tool) -- Giacomo — create and initialise an AI-EVERSE repository for collecting EVERSE work on AI and research software quality (guidelines, skills files, recommendations) -- Giacomo — create GitHub issues per RF section; post to Mattermost for volunteer assignment -- Shoaib — draft audience statement for RF v3 (first draft, to be iterated); review and update scope and goals section -- Michael — review definitions section; share AI/RSQKit draft page (using AI to improve RSQ) within days -- All — review RF v2.1 on GitHub; flag issues or questions +## B. Africa engagement event — discussion -### Updates +Daniel: several current indicators are better described as project health metrics rather than software quality metrics. RSQKit also lacks technical code quality indicators (cyclomatic complexity, coupling, maintainability) — adding them risks losing the science cluster audience due to terminology. Agreement: no new dimensions to be added at this stage. Daniel suggested reframing as a "quality and health framework" — noted, not agreed. -**Feedback from EVERSE Africa engagement event** +Faruk: needs frequent indicator releases so dashboards stay in sync with RSQKit. -- Good practices breakout (n=9): participants were experienced — all familiar with version control, testing, CI/CD, documentation and code review. Software management plans had the lowest current use (6/9) but was the only practice selected by all respondents as planned for adoption. Main obstacles: skills deficit, time, funding focused on new features rather than maintenance. -- Indicators breakout (n=9): lower baseline familiarity than practices. Test coverage most widely measured (6/9); maintainability least (2/9), but highest planned uptake (4/6) — largest gap of any indicator. Obstacles include expertise, connectivity constraints, and difficulty measuring quality for externally distributed software. -- Michael Sparks has been developing an idea around software entropy as a lens for formalising metrics currently measured informally (brittleness, code churn, entanglement, coupling). The concept draws on Lehman's laws of software evolution. One Africa event respondent independently cited software entropy as a needed concept — worth tracking as a candidate for the indicators repository. -- Daniel flagged post-GAM that some indicators are better characterised as project health metrics rather than software quality indicators. The Africa poll data supports this: respondents spontaneously listed forks, active contributor counts, and resourcing alongside code-level metrics. Worth deciding whether the RF or the indicators repository should make this distinction explicit. -- The poll data offers indirect support for community as an additional quality dimension: respondents unprompted listed forks, open issues, and active contributor counts as metrics they already track, and cited domain knowledge transfer and team dynamics as quality obstacles. No respondent explicitly requested a community dimension, so the evidence is inferential rather than direct. +Giacomo proposed an industry engagement workshop in September/October for external feedback. Shoaib skeptical about relevance of industry to research software context; left open. -**Community dimension update** +## C. Section ownership -Added a new Community dimension (section 2.5) to the Reference Framework, covering community health for research software: governance structures, contributor engagement, communication channels, community health metrics, and integration with research communities. The section includes good enough practices and a tools list. A tracking issue (#18) has been opened with subtasks to review overlaps with the Sustainability, Open Source Software, FAIR, and Technical dimensions. All sections are open for review. PR #19 is open for review. +Assignments agreed: -**Reference Framework review plan** +| Issues | Owner | +|--------|-------| +| #4 Introduction, #5 Framework overview (incl. audience statement) | Shoaib | +| #6 Technical, #7 FAIRness, #8 OSS, #9 Sustainability, #18 Community | Daniel | +| #10 Four Views overview, #11 Three-Tiers view | Thomas | +| #12 Lifecycle, #13 Personas, #14 Science Clusters, #15 Conclusions | TBC — Giacomo to find owners | -A section owners table has been added to the README, with one row per section linked to a dedicated tracking issue in the upstream repository. Issues #4–#15 cover all existing sections (Introduction, Framework overview, each dimension, all four Views, and Conclusions); issue #18 covers the new Community dimension. All sections are open for review. +Senem Otles (WP5.3): read the document, wants to embed training references in the lifecycle/personas sections. Giacomo to open an issue. -Giacomo has posted to Mattermost inviting volunteers to claim sections by opening a PR to add their name to the table. Where no volunteer comes forward, owners will be assigned. +## D. AI and EVERSE -### AI and EVERSE +**Hugo Bacard update:** Built a chatbot connected to RSQKit files; awaiting feedback. Meeting with Daniel/Stefan to review it never took place. Separately building an AI agent to populate the training catalogue with Kenneth (meeting ~end of April). Confirmed attendance for 18 May. -Two tracks confirmed at 23 March meeting: +Shoaib feedback on chatbot: needs to be trained not only on RSQKit pages but also on what they link to. MCP approach now preferred over RAG. Shoaib positive about deploying it; noted UKRI funders are asking what projects are doing with AI. Hugo: has model access; deployment as a service needs permission. -**Track 1 — policy and position:** high-level recommendations on AI and research software quality, feeding into the project policy brief (due February 2027). SSI workshop report (Edinburgh, March) expected ~2 months; to be circulated as input when available. +AI skills files discussion: concern raised about social acceptability of AI-drafted content. General view: proceed openly with AI assistance, transparency required. Faruk: general principles safer than specific tool guidance given pace of change. Giacomo: will check feasibility of AI work within project scope with Fotis. -**Track 2 — practical RSQKit guidance:** three pages scoped: (1) using tools to improve research software quality; (2) using AI to develop research software; (3) using AI to assess and improve research software quality. Michael circulating draft of page 3 for comment. +## Key actions -For discussion: -- Agree AI workplan for remaining 11 months -- EVERSE-flavoured AI skills files — scope and ownership (Faruk, David/Hugo) -- Hugo Bacard update (expected at this meeting): AI work at CERN, RSQKit chatbot prototype, AI-assisted metadata for training catalogue +- **Giacomo** — check AI work feasibility/legitimacy with Fotis; find owners for #12, #13, #14, #15; open issue for Senem/training references +- **Daniel** — review and improve sections #6–#9, #18; add missing technical indicators to indicators catalogue; open tracking issues +- **Shoaib** — review and own #4, #5; draft audience statement +- **Thomas** — review and own #10, #11 +- **Hugo** — schedule feedback meeting with Daniel/Stefan on chatbot; attend 18 May +- **Faruk** — complete citation files review round ### Next meeting From 2f14fc6dd7c5451c2c5ea486340eb162f93301b0 Mon Sep 17 00:00:00 2001 From: Giacomo Peru Date: Fri, 15 May 2026 15:12:25 +0100 Subject: [PATCH 2/2] Add TF2 agenda for 18 May 2026 Co-Authored-By: Claude Sonnet 4.6 (1M context) --- meetings/tf2-rolling-notes.md | 41 +++++++++++++++++++++++++++++++++++ 1 file changed, 41 insertions(+) diff --git a/meetings/tf2-rolling-notes.md b/meetings/tf2-rolling-notes.md index 6a7be5c..60d0074 100644 --- a/meetings/tf2-rolling-notes.md +++ b/meetings/tf2-rolling-notes.md @@ -2,6 +2,47 @@ Repository: +# TF2 Meeting Agenda — 18 May 2026 + +**Date:** Monday, 18 May 2026 **Time:** 11:00 UK / 12:00 CET **Location:** + +**Attending:** + +**Apologies:** + +## A. Actions from 20 April + +- Giacomo — check AI work feasibility/legitimacy with Fotis +- Giacomo — find section owners for #12 (Lifecycle), #13 (Personas), #14 (Science Clusters), #15 (Conclusions) +- Giacomo — open issue for Senem/training references +- Daniel — review and improve sections #6–#9, #18; add missing technical indicators to indicators catalogue +- Shoaib — review and own #4, #5; draft audience statement +- Thomas — review and own #10, #11 +- Hugo — schedule and hold feedback meeting with Daniel/Stefan on chatbot +- Faruk — complete citation files review round + +## B. RF section review — progress and open PRs + +- Thomas: sustainability chapter PR open on upstream (`sustainability` branch) — review and merge plan +- Daniel: progress on technical dimensions and indicators +- Shoaib: audience statement draft +- Outstanding owners for #12, #13, #14, #15 — assign or defer + +## C. AI and EVERSE + +- Feasibility/scope check result (Giacomo/Fotis) +- Hugo: chatbot update — feedback from Daniel/Stefan; direction (MCP approach); deployment question +- Hugo: training catalogue agent — progress with Kenneth +- Agree AI workplan for remaining ~10 months: priorities, owners, timeline + +## D. AOB + +- Training references in RF — Senem Otles issue (WP5.3) + +## Key actions + +--- + # TF2 Meeting Minutes — 20 April 2026 **Date:** Monday, 20 April 2026 **Time:** 11:00 UK / 12:00 CET **Location:**