Internship | Traffic Light Recognition Perception System Development

At TNO, we develop software for Automated Driving vehicles. In order to behave appropriately, vehicles have to be able to sense their environment. For intersection crossing, one of the many environment perception algorithms required needs to detect the status of traffic lights, corresponding to the section of the road that the vehicle currently is driving on.

One of the challenges in Automated Driving is “Environment Perception”. The vehicle decision is based on the current assessment of the vehicles’ surroundings. In order to do so, different environment perception algorithms are required.

One of the systems that could help autonomous vehicles increase traffic flow, and throughput is Green Light Optimized Speed Assist (GLOSA). For GLOSA, the vehicle receives information about the current and next phase of the traffic light status, including switching time. With onboard perception, the vehicle needs to detect the traffic light status in order to confirm the correctness of the received traffic light information. In this internship you will:

• Train an algorithm for automated Traffic Light Recognition
• Integrate the traffic light recognition on one of TNO’s research vehicles and validate the performance
• Develop tools for visualization of the traffic light status in a graphical user interface

Proposed approach:

• Data Preparation: Inspect the in-house, annotated dataset with traffic light 2D bounding boxes, ensure proper preprocessing of the data for training.
• Model Selection and Development: Choose or customize a neural network architecture using frameworks like TensorFlow or PyTorch, tailoring it for the target perception task of real-time ob-ject detection.
• Training the Model: Train the model on the dataset and include hyperparameter tuning. The output format is still to be determined, but it will most probably be 2D bounding box estimation, with association to the lane network (i.e., which traffic light corresponds to which lane?).
• Documentation: Document the system architecture, datasets, and testing results.

When time allows:

• Integration with Vehicle Systems: Deploy the trained model on an onboard computing platform (e.g., Nvidia Jetson), ensuring compatibility with real-time camera input and processing pipelines.
• Real-World Testing and Iteration: Test the system in diverse operational scenarios, gather data on edge cases, and iteratively improve the model by retraining with additional data.

What can you expect of your work situation?
You will work at the Integrated Vehicle Safety department of TNO on the Automotive Campus in Helmond. In this department people are working on developing software for automated driving vehicles. The developed software is tested in pilots and on the public road. (more info on the department: https://www.tno.nl/en/about-tno/organisation/units/mobility-built-environment/research-integrated-vehicle-safety/). The people are young, enthusiastic and driven. You will work in an open area, within your own team. One of our employees will be your mentor. He will help you to get acquainted with the department and give you guidelines for your research in order to help you to get the best out of it.

Related Videos:
Integrated Vehicle Safety
A recent demonstrator

We require that you are familiar with training of image-based neural networks environment perception. You will work with an annotated dataset, where possibly transformations are required to align the camera specifications of the training data set with the validation data. You are knowledgeable in programming (please indicate your programming language strengths in your application) and willing to learn. Experience with Linux and ROS is beneficial. We would like you to start as soon as possible. The internship fits a 3-month project (based on full-time availability). Familiarity with vehicle automation is a plus. Finally, successful candidates should be able to spend at least 2 days a week in our TNO Helmond premises to enable you to work with our tools and to have short communication lines.

You want an internship opportunity on the precursor of your career; an internship gives you an opportunity to take a good look at your prospective future employer. TNO goes a step further. It’s not just looking that interests us; you and your knowledge are essential to our innovation. That’s why we attach a great deal of value to your personal and professional development. You will, of course, be properly supervised during your work placement and be given the scope for you to get the best out of yourself. Furthermore, we provide:

• A highly professional, innovative internship environment, within a team of top experts.
• A suitable internship allowance (615 euro for wo-, hbo- and mbo-students, for a full-time internship).
• Possibility of eight hours of free leave per internship month (for a full-time internship).
• A free membership of Jong TNO, where you can meet other TNO professionals and join several activities, such as sports activities, (work-related) courses or the yearly ski-trip.
• Use of a laptop.
• An allowance for travel expenses in case you don’t receive an OV-card.

At TNO, we innovate for a healthier, safer and more sustainable life. And for a strong economy. Since 1932, we have been making knowledge and technology available for the common good. We find each other in wonder and ingenuity. We are driven to push boundaries. There is all the space and support for your talent and ambition. You work with people who will challenge you: who inspire you and want to learn from you. Our state-of-the-art facilities are there to realize your vision. What you do at TNO matters: impact makes the difference. Because with every innovation you contribute to tomorrow’s world. Read more about TNO as an employer.

At TNO we encourage an inclusive work environment, where you can be yourself. Whatever your story and whatever unique qualities you bring to the table. It is by combining our unique strengths and perspectives that we are able to develop innovations that make a real difference in society. Want to know more? Read what steps we are taking in the area of diversity and inclusion.

After the first CV selection, the application process will be conducted by the concerning department. TNO will provide a suitable internship agreement. If you have any questions about this vacancy, you can contact the contact person mentioned below.

Important to be aware of before applying:

• Before the start of the internship, the internship agreement from TNO needs to be signed. For students at a college or university based in the Netherlands, TNO uses the UNL-template (supplemented with a number of specific agreements from TNO). For students of foreign and MBO educational institutions, the TNO internship agreement applies. TNO does not sign any other internship agreements.
• Before the start of the internship, the educational institution will need to confirm in writing that:
  • 1) you are enrolled at the educational institution during the internship, and;
  • 2) the internship takes place as part of the programme of the study.
• The confirmation of educational institution takes place by signing the UNL template or forms prepared by TNO.
• Interns at TNO must be in possession of a Dutch residential address at the start of the internship. Performance of internship activities from abroad is not possible.