<div><ol> <li> De Gelder, E., Op den Camp, O. "Scenario-based assessment of automated driving systems: How (not) to parameterize scenarios?", 2024. <a lang="en-US" href="https://arxiv.org/pdf/2409.01117" class="langBlock externLink">https://arxiv.org/pdf/2409.01117</a> </li> <li> De Gelder, E., Buermann, M., Op den Camp, O. "Coverage Metrics for a Scenario Database for the Scenario-Based Assessment of Automated Driving Systems", 2024. <a lang="en-US" title="https://arxiv.org/pdf/2409.01139" href="https://arxiv.org/pdf/2409.01139" target="_blank" class="langBlock externLink extern">https://arxiv.org/pdf/2409.01139</a> </li> <li>De Gelder, E., Paardekooper, J.-P., Khabbaz Saberi, A., Elrofai, H., Op den Camp, O., Kraines, S., Ploeg, J., De Schutter, B., "Towards an Ontology for Scenario Definition for the Assessment of Automated Vehicles: An Object-Oriented Framework," in IEEE Transactions on Intelligent Vehicles, vol. 7, no. 2, pp. 300-314, June 2022, DOI: 10.1109/TIV.2022.3144803.</li> <li>Op den Camp, O., van de Sluis, J., de Gelder, E., and Yalcinkaya, I., “Generation of Tests for Safety Assessment of V2V Platooning Trucks”, in 27th ITS World Congress, Hamburg, 2021.</li> <li>Van de Sluis, J., Op den Camp, O., Broos, J., Yalcinkaya, I., and de Gelder, E., “Describing I2V Communication in Scenarios for Simulation-Based Safety Assessment of Truck Platooning.” Electronics 10, 1 (2021), <a href="https://doi.org/10.3390/electronics10192362" class="externLink">https://doi.org/10.3390/electronics10192362</a>.</li> <li> Zlocki, A., Op den Camp, O., Arrúe, Á., Taniguchi, S., Umeda, M., Watanabe, S., and Antona-Makoshi, J., “Towards the Harmonization of Safety Assessment Methods of Automated Driving: SAKURA – SIP-adus - HEADSTART, <a href="https://www.headstart-project.eu/wp-content/uploads/2021/12/211209_HEADSTARTSAKURA_WP_Final-draft.pdf" class="externLink">White Paper</a>” December 9, 2021. </li> <li> De Gelder, E., Elrofai, H., Khabbaz Saberi, A., Op den Camp, O., Paardekooper, J.-P., and De Schutter, B., “Risk Quantification for Automated Driving Systems in Real-World Driving Scenarios”, IEEE Access 9, vol. 9, pp. 168953-168970, 2021, DOI: 10.1109/ACCESS.2021.3136585. </li> <li>“ISO/TR 21934-1:2021 Road Vehicles — Prospective Safety Performance Assessment of Pre-Crash Technology by Virtual Simulation — Part 1: State-of-the-Art and General Method Overview.” <a href="https://www.iso.org/cms/render/live/en/sites/isoorg/contents/data/standard/07/64/76497.html" class="externLink">https://www.iso.org/cms/render/live/en/sites/isoorg/contents/data/standard/07/64/76497.html</a></li> <li>De Gelder, E., Manders, J., Grappiolo, C., Paardekooper, J.-P., Op den Camp, O., and De Schutter, B., "Real-World Scenario Mining for the Assessment of Automated Vehicles," 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), 2020, pp. 1-8, DOI: 10.1109/ITSC45102.2020.9294652.</li> <li> De Gelder, E., Op den Camp, O., and de Boer, N., “Scenario Categories for the Assessment of Automated Vehicles – version 1.7”, Technical Report, Nanyang Technological University, Singapore: CETRAN, 2020. <a href="http://cetran.sg/wp-content/uploads/2020/01/REP200121_Scenario_Categories_v1.7.pdf" class="externLink">http://cetran.sg/wp-content/uploads/2020/01/REP200121_Scenario_Categories_v1.7.pdf</a>. </li> <li> Kalisvaart, S., Slavik, Z., and Op den Camp, O., “Using Scenarios in Safety Validation of Automated Systems.” In: Leitner, A., Watzenig, D., Ibanez-Guzman, J. (eds) Validation and Verification of Automated Systems. Springer, 2020, Cham. <a href="https://www.springer.com/gp/myspringer/chapters" class="externLink">https://www.springer.com/gp/myspringer/chapters</a>. </li> <li> Paardekooper, J.-P., van Montfort, S., Manders, J., Goos, J., de Gelder, E., Op den Camp, O., Bracquemond, A., and Thiolon, G., “Automatic Identification of Critical Scenarios in a Public Dataset of 6000 km of Public-Road Driving”, in 26th International Technical Conference on the Enhanced Safety of Vehicles (ESV), Eindhoven, 2019. </li> <li> Elrofai, H., Paardekooper, J.-P., de Gelder, E., Kalisvaart, S., and Op den Camp, O., “Scenario-Based Safety Validation of Connected and Automated Driving.”, Vision Paper TNO, 2018. <a href="https://publications.tno.nl/publication/34626550/AyT8Zc/TNO-2018-streetwise.pdf" class="importLink">https://publications.tno.nl/publication/34626550/AyT8Zc/TNO-2018-streetwise.pdf (pdf)</a> . </li> <li>Op den Camp, O., van Montfort, S., Uittenbogaard, J., and Welten, J., “Cyclist Target and Test Setup for Evaluation of Cyclist-Autonomous Emergency Braking”, in International Journal of Automotive Technology, Vol. 18, No. 6, pp. 1085-1097, 2017. DOI: 10.1007/s12239−017−0106−5</li> </ol></div>

<div><ul> <li><a href="https://www.hi-drive.eu/" class="externLink">EU H2020 Hi-Drive</a> (2021-2025): Large-scale pilot for prolonged automation without interruptions (continuous ODD). Data analysis, edge cases, simulation.</li> <li><a href="https://blogs.sw.siemens.com/simcenter/launch-of-streetwise-project-to-enable-safe-automated-driving-using-scenario-based-virtual-assessment/" class="externLink">TKI StreetWise Plus</a> (2021-2022): Extension of scenario database for multi-actor simulation, I2V messages and roadside data sources. With Siemens and Itility.</li> <li><a href="https://www.connectedautomateddriving.eu/about/arcade/" class="externLink">EU H2020 ARCADE</a> (2018-2022): Coordination and support project for CCAM projects. Stakeholder workshops on <a href="https://www.connectedautomateddriving.eu/4th-stakeholder-workshop-on-common-evaluation-methodology/" class="externLink">common evaluation methodology</a> (Nov 2020) and <a href="https://www.connectedautomateddriving.eu/blog/event/workshop-on-edge-cases-for-automated-driving/" class="externLink">edge cases</a> (May 2021).</li> <li><a href="https://www.headstart-project.eu/wp-content/uploads/2021/12/211209_HEADSTARTSAKURA_WP_Final-draft.pdf" class="externLink">EU H2020 Headstart</a> (2018-2021): Scenario-based safety assessment methodology including V2X, localisation and cyber security. Detailed methods for scenario selection and allocation to test methods. Use case truck platooning.</li> <li>TNO PUMAS (2018-2020): Multi-partner scenario database project with AVL, Magna, Siemens and a Japanese OEM. Proof of concept of sharing scenarios from diverse driving datasets for 1,000 hours of data. Including completeness metrics.</li> <li><a href="https://l3pilot.eu/" class="externLink">EU H2020 L3Pilot</a> (2017-2021): Large-scale pilot for L3 automation. Data analysis and impact assessment for Jaguar Land Rover and Aptiv. Evaluation of lane-change detection.</li> <li><a href="https://enable-s3.eu/" class="externLink">EU ECSEL ENABLE-S3</a> (2016-2019): Virtual verification and validation of automated systems. Methodology, scenario working group, valet parking use case, image-guided surgery use case, dataset inventory.</li> </ul></div>

StreetWise: scenario based safety assessment for automated driving.

Meet the expert 5 November - 16 December

Join the route to safe automated driving and meet our experts online.

Register now

To optimally calculate the safety risks, virtual simulations need to be based on realistic test cases and characteristics. TNO StreetWise uses public road driving data as input for scenario identification and storage, and test cases are based on such scenarios. Thanks to this method the virtual test cases are representative for real-world scenarios. To ensure a safe implementation of Automated Driving (AD) technologies and to achieve a positive risk balance, TNO offers innovative risk quantification methods and scenario statistics.

Advanced safety methodology

Our Safe & Social programme consists of automated systems to exhibit 'responsible, predictable, and conflict-avoiding behaviour. Where this programme aims at adopting driving behaviour that contributes to road safety, the innovation programme StreetWise focuses on preventing unsafe situations that could lead to harm people. Based on TNO’s extensive experience with vehicle safety assessment, the TNO StreetWise methodology addresses operational safety. This is a translation of functional safety (ISO26262) and safety of the intended functionality (ISO/DIS 21448:2021 SOTIF). [2] [4] [7].

After all, the automation technology takes over tasks from the human driver and should be prepared for all situations in the operational domain designed for (ODD). This advanced methodology is substantiated by a series of scientific articles.

Safer automated driving

Challenges for the tested systems are determined and quantified by combining systematic descriptions of the vehicle’s surroundings in scenarios, with systematic (statistical) analysis of the vehicle behaviour in such scenarios. By using statistical data from the exposure to different scenarios, we can quantify risk based on these simulations [2] [5].

By doing so, our industrial clients can make significant steps towards safer automated driving. Authorities responsible for type approval can use TNO StreetWise’s quantified risk estimation to determine the safety of a vehicle before allowing it for deployment onto the public road.

Efficient and flexible pipeline

The TNO StreetWise pipeline automatically processes your driving data into activities, scenarios, parameters and statistics. New types of scenarios can be added quickly using the underlying framework. Python algorithms, running in a cloud environment, ensure flexibility and scalability The pipeline is ready for connected vehicles as well (V2X, I2V).

A webGUI provides easy access to the scenario database for extraction of OpenSCENARIO test cases, including the related Euro NCAP tests. Test automation is supported through an API, as successfully demonstrated with AVL ModelConnect, Vires VTD and Siemens Simcenter PreScan. Sensitive driving data can be processed at the client’s premises.

CCAM community: Valuable network

Our clients benefit from the extensive TNO network of partners. For example, we are champion in a certified Euro NCAP test body, and working on the development of the Cyclist-AEB test protocol (CATS). TNO is also working on the way how Euro NCAP can use scenario databases.

The list of partners in B2B and EU projects includes most of the CCAM community (e.g., SAKURA [1], NTU CETRAN (Singapore), AVL [9], Siemens, Itility, Magna [9], IDIADA [1], BMW [7], Volvo [7], Continental [7], ika [1] [7], Virtual Vehicle [9], and VEDECOM).

Download the paper

The paper Scenario-Based Safety Assessment of Automated Driving Systems is essential for anyone involved in scenario-based safety assessment or seeking to gain insights into its evaluation process.

Download paper

More about this project

De Gelder, E., Op den Camp, O. "Scenario-based assessment of automated driving systems: How (not) to parameterize scenarios?", 2024. https://arxiv.org/pdf/2409.01117
De Gelder, E., Buermann, M., Op den Camp, O. "Coverage Metrics for a Scenario Database for the Scenario-Based Assessment of Automated Driving Systems", 2024. https://arxiv.org/pdf/2409.01139
De Gelder, E., Paardekooper, J.-P., Khabbaz Saberi, A., Elrofai, H., Op den Camp, O., Kraines, S., Ploeg, J., De Schutter, B., "Towards an Ontology for Scenario Definition for the Assessment of Automated Vehicles: An Object-Oriented Framework," in IEEE Transactions on Intelligent Vehicles, vol. 7, no. 2, pp. 300-314, June 2022, DOI: 10.1109/TIV.2022.3144803.
Op den Camp, O., van de Sluis, J., de Gelder, E., and Yalcinkaya, I., “Generation of Tests for Safety Assessment of V2V Platooning Trucks”, in 27th ITS World Congress, Hamburg, 2021.
Van de Sluis, J., Op den Camp, O., Broos, J., Yalcinkaya, I., and de Gelder, E., “Describing I2V Communication in Scenarios for Simulation-Based Safety Assessment of Truck Platooning.” Electronics 10, 1 (2021), https://doi.org/10.3390/electronics10192362.
Zlocki, A., Op den Camp, O., Arrúe, Á., Taniguchi, S., Umeda, M., Watanabe, S., and Antona-Makoshi, J., “Towards the Harmonization of Safety Assessment Methods of Automated Driving: SAKURA – SIP-adus - HEADSTART, White Paper” December 9, 2021.
De Gelder, E., Elrofai, H., Khabbaz Saberi, A., Op den Camp, O., Paardekooper, J.-P., and De Schutter, B., “Risk Quantification for Automated Driving Systems in Real-World Driving Scenarios”, IEEE Access 9, vol. 9, pp. 168953-168970, 2021, DOI: 10.1109/ACCESS.2021.3136585.
“ISO/TR 21934-1:2021 Road Vehicles — Prospective Safety Performance Assessment of Pre-Crash Technology by Virtual Simulation — Part 1: State-of-the-Art and General Method Overview.” https://www.iso.org/cms/render/live/en/sites/isoorg/contents/data/standard/07/64/76497.html
De Gelder, E., Manders, J., Grappiolo, C., Paardekooper, J.-P., Op den Camp, O., and De Schutter, B., "Real-World Scenario Mining for the Assessment of Automated Vehicles," 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), 2020, pp. 1-8, DOI: 10.1109/ITSC45102.2020.9294652.
De Gelder, E., Op den Camp, O., and de Boer, N., “Scenario Categories for the Assessment of Automated Vehicles – version 1.7”, Technical Report, Nanyang Technological University, Singapore: CETRAN, 2020. http://cetran.sg/wp-content/uploads/2020/01/REP200121_Scenario_Categories_v1.7.pdf.
Kalisvaart, S., Slavik, Z., and Op den Camp, O., “Using Scenarios in Safety Validation of Automated Systems.” In: Leitner, A., Watzenig, D., Ibanez-Guzman, J. (eds) Validation and Verification of Automated Systems. Springer, 2020, Cham. https://www.springer.com/gp/myspringer/chapters.
Paardekooper, J.-P., van Montfort, S., Manders, J., Goos, J., de Gelder, E., Op den Camp, O., Bracquemond, A., and Thiolon, G., “Automatic Identification of Critical Scenarios in a Public Dataset of 6000 km of Public-Road Driving”, in 26th International Technical Conference on the Enhanced Safety of Vehicles (ESV), Eindhoven, 2019.
Elrofai, H., Paardekooper, J.-P., de Gelder, E., Kalisvaart, S., and Op den Camp, O., “Scenario-Based Safety Validation of Connected and Automated Driving.”, Vision Paper TNO, 2018.
https://publications.tno.nl/publication/34626550/AyT8Zc/TNO-2018-streetwise.pdf (pdf) .
Op den Camp, O., van Montfort, S., Uittenbogaard, J., and Welten, J., “Cyclist Target and Test Setup for Evaluation of Cyclist-Autonomous Emergency Braking”, in International Journal of Automotive Technology, Vol. 18, No. 6, pp. 1085-1097, 2017. DOI: 10.1007/s12239−017−0106−5

EU H2020 Hi-Drive (2021-2025): Large-scale pilot for prolonged automation without interruptions (continuous ODD). Data analysis, edge cases, simulation.
TKI StreetWise Plus (2021-2022): Extension of scenario database for multi-actor simulation, I2V messages and roadside data sources. With Siemens and Itility.
EU H2020 ARCADE (2018-2022): Coordination and support project for CCAM projects. Stakeholder workshops on common evaluation methodology (Nov 2020) and edge cases (May 2021).
EU H2020 Headstart (2018-2021): Scenario-based safety assessment methodology including V2X, localisation and cyber security. Detailed methods for scenario selection and allocation to test methods. Use case truck platooning.
TNO PUMAS (2018-2020): Multi-partner scenario database project with AVL, Magna, Siemens and a Japanese OEM. Proof of concept of sharing scenarios from diverse driving datasets for 1,000 hours of data. Including completeness metrics.
EU H2020 L3Pilot (2017-2021): Large-scale pilot for L3 automation. Data analysis and impact assessment for Jaguar Land Rover and Aptiv. Evaluation of lane-change detection.
EU ECSEL ENABLE-S3 (2016-2019): Virtual verification and validation of automated systems. Methodology, scenario working group, valet parking use case, image-guided surgery use case, dataset inventory.

TNO and Torc Robotics collaborate to use real-world data for autonomous truck validation

Torc Robotics, an independent subsidiary of Daimler Truck and TNO are working together to substantiate the safety of self-driving trucks using scenario-based safety validation.

Discover more

Contact us

Skip navigation (Contact us)

Olaf Op den Camp

Functie:
Senior consultant
Development and practical deployment of scenario-based safety assessment methods for Assisted Driving and Automated Driving Systems is my passion and expertise.

International harmonization and standardization of methods and tools for scenario-based safety assessment is my ambition.

More about Olaf
- Standplaats:
  Helmond
- Email:
  Email Olaf
Looking for another expert?
View all experts

Back to navigation (Contact us)

Get inspired

28 resultaten, getoond 1 t/m 5

Enhancing road safety by extending the vehicle's horizon with the Digital Road Infrastructure

Informatietype:: Insight

11 November 2024

An effective Digital Road Infrastructure (DRI) is based on trust, which is currently lacking. TNO’s expertise and coordination skills can help break the current deadlock, according to experts Peter-Paul Schackmann and Daniel Altgassen.