Software Engineer - AR/VR, C/C++, Python, Image Processing & Analysis

Job Description

We are seeking a software engineer to help with data collection tooling for large scale data collection efforts for AR/VR headsets. This is an opportunity to work on early versions of consumer hardware on cutting edge technology involving cameras and natural user interfaces. This role will also support camera and illuminator calibration for prototype devices.

Job Responsibilities

• Design and implement tools for data collection and annotation, including:
  • Controlling the camera exposure and gain on mobile device (VR and/or AR headset)
  • Capturing image stream and metadata
  • Automatic upload to database
• Run evaluations to automatically verify the quality of data collected from large scale data collections, flagging cases for principal investigators to check
• Provide documentation of usage of tools for external vendors
• Modify our tools (C++, python) to take care of new requirements
• Synchronize SW that drives robotic arm movement with the camera capture
• Implement data capture script for collection of camera images
• Work collaboratively with the Mechanical Engineers on fixturing the prototype device in the calibration station
• Modify existing calibration algo to consume the collected images and produce calibration parameters in specified format
• Implement a test to validate calibration quality

Required Skills

• Data engineering and distributed/cloud systems
• Hardware control software development
• Camera and light fixture calibration
• C++ and Python expertise
• Creativity, verbal and written communication skills and problem solving ability are required
• Verbal and written communication skills; communication across teams including engineers and researchers
• Ability to work independently and manage one's time

Preferred Skills

• Experience with deep learning, PyTorch, OpenCV