- User submit queries as job packets in a Five Safes RO-Crate via an API on a publicly available Submission portal. Queries are then presented on a query queue.
- The job packets are pulled down into a demilitarised polling zone on a TRE via a secure outbound only API connection. Connection between TREs and the Submission Layer are managed by HUTCH.
- Job packets are authenticated and then presented on an internal queue.
- A second outbound only API pulls the job packets into the main Controlled zone of the TRE.
- The job packet is passed to WfExS which executes published approved workflows on data, generate results and adds them to the job packet, including workflow information and providence.
- Subject to appropriate disclose control the job packet is returned to the TRE Polling zone and stored.
- Further disclosure checks are applied, and the job packet is released back to the submission layer where it is held on a results queue to be collected by the user.
- Subject to deidentification, the job packet is also published on the HDR data use register.
Work packages
The TRE-FX project runs for 9 months starting 2023-02-01 until 2023-09-31.
Plan:
- WP1: PPIE
- Promote the inclusion of under-represented groups (as required)
- ✓ Plan PPIE engagement events for external audiences
- Provide bespoke support to peoples (as required)
- Promote public engagement work across TRE-FX
- Host PPIE engagement events for external audiences
- Deliver a PPIE video discussing the implementation
- WP2: Transparency
- ✓ Develop a Five Safes RO-Crate
- ✓ Plan workshop to explore Five Safes RO-Crate requirements with all Stakeholders
- Develop a whitepaper based on the Five Safes RO-Crate
- ✓ Review the current mechanisms of accessing the HDR Data Use Register
- Develop HDR data use register to accept Five Safes RO-Crate
- ✓ Deliver a workshop on RO-Crate profile requirements with external Stakeholders
- Deliver the whitepaper based on the Five Safes RO-Crate
- Deliver HDR data use register for Five Safes RO-Crate API integration
- WP3: Microservice Development
- Development of Controlled layer APIs and microservices
- ✓ Development of TRE polling layer APIs and microservices
- ✓ Development of Submission layer APIs and microservices
- Continued development and bug fixing
- Deliver working version of polling and controlled layer APIs and microservices
- Deliver working version of submission layer APIs and microservices
- WP4: TRE integration
- ✓ Informed system design of reference implementation
- Review final release of reference implementation with TREs and other Stakeholders
- Deploy the API and microservices architecture on TREs
- Review architecture implementation with external Stakeholders
- TRE polling and controlled layer components deployed across the TREs
- Outbound communication with submission layer established
- WP5: Federated Analytics Testing
- Development and testing of federated analytic workflows
- Testing on queries on reference implementation across TREs
- Basic user authentication and disclosure control testing
- Publish DataSHIELD and Bitfount WfExS open-source workflow to workflowhub.eu
- Federated analytic workflows validated on TREs
Work package plans are subject to change