We are looking for a Staff Data Engineer
To join one of the 100 Best Companies to Work For, with offices in the Chicagoland area and remote flexibility, on a full-time basis. This leading supplier of maintenance, repair, and operating products for businesses and a wide range of industries across the globe has a focus on sustainability, social responsibility, and community engagement, serving more than 4.5 million customers worldwide.
As a Staff Data Engineer
You will help the team by contributing to ongoing architecture, development, and mentor junior engineers. The ideal candidate will have a strong background in data engineering, with a focus on Databricks, and have experience implementing real-time streaming technologies. Having experience IaC will be an added bonus.
We encourage you to apply for this exciting opportunity and be part of a company that values sustainability, social responsibility, community engagement, innovation, and growth.
Required Skills & Experience
- As the technical lead and architect, your primary responsibility will be to design and implement highly efficient, reusable, and scalable data processing systems and pipelines in Databricks and Snowflake.
- Design and implement technical solutions and processes to ensure data reliability and accuracy.
- Develop data models and mappings and build new data assets required by users. Perform exploratory data analysis on existing products and datasets.
- Educate data engineering teams in adopting new data patterns and tools.
- Function as SME within this area when engaging with our AI, Platform, and Business Analytics teams to build useful pipelines and data assets.
Desired Skills & Experience
- Experience in batch and streaming ETL using Spark, Python, Scala, Snowflake or Databricks for Data Engineering or Machine Learning workloads.
- Experience orchestrating and implementing pipelines with workflow tools like Databricks Workflows, Apache Airflow, or Luigi.
- Experience prepping structured and unstructured data for data science models.
- Experience with containerization and orchestration technologies (Docker, Kubernetes) and experience with shell scripting in Bash, Unix or windows shell is preferable.
- Implemented CI/CD with automated testing in Jenkins, Github Actions, or Gitlab CI/CD.
- Familiarity with AWS Services not limited to Glue, Athena, Lambda, S3, and DynamoDB.
- Demonstrated experience implementing data management lifecycle, using data quality functions like standardization, transformation, rationalization, linking, and matching.
The Offer
- Bonuseligible
You will receive the following benefits:
- Medical, dental, vision, and life insurance plans.
- Paid time off (PTO) and 6 company holidays per year.
- Automatic 6% 401(k) company contribution each pay period.
- Employee discounts, parental leave, 3:1 match on donations, and tuition reimbursement.
- A comprehensive set of emotional, financial, physical, and social well-being programs.
Applicants must be currently authorized to work in the US on a full-time basis now and in the future.
#LI-EM1