The Final Challenge Workshop is aimed at evaluating the results achieved by the Challengers in Stage III and selecting the EuRoC Winner. Evaluation of the results achieved by the Challengers in Stage III will be performed by a Board of Judges (BoJ) composed by: the Challenge Advisor at Large (CAL), as the technical/scientific stakeholder who has supervised the three challenges in all their various stages and rounds, the Challenge Advisor for European Robotics Industries (CAERI), as the expert for exploitation of the results of the challenges, along with 5 external stakeholders (a representative from the field of policy making or government, a representative from a large manufacturing company, a representative from an SME, a representative of the entrepreneur/venture capitalist community, and a media/social expert).
For evaluation purposes, the following material is provided to the BoJ:
objectives/targets for Stage III determined by teams and submitted in advance to EuRoC in a deliverable (Quantifiable Objectives of Field Tests);
a report prepared by each team (Field Tests Report), describing the activities carried out by each participant and the results achieved during Stage III, as well as the extent to which objectives and targets have been met; the report contains a one-page publishable summary as well;
videos captured by teams, showing and archiving their activities and results during Stage III (one video per team, no longer than 10 minutes in length and 500MB in size);
a statement of verification of the extent to which the Challenge Hosts have witnessed the claims included in the Field Tests Report demonstrated;
interviews with Challenger Teams carried out by the BoJ at the Challenge Workshop.
Evaluation will be based on the ex-post assessment of 3 criteria:
- scientific and technical quality of the achieved results,
- efficiency of the implementation of the activities,
- potential impact of the results.
An annotated ranking and selection of the Challenger Teams will be compiled at the end of the Challenge Workshop, together with Evaluation Summary Reports (ESRs). The ESRs and meeting minutes will be forwarded to the European Commission by the EuRoC Coordinator. Upon approval by the European Commission, the EuRoC winner will be selected.