Python AWS SQL NoSQL Data Pipeline Engineer

Responsibilities

• Design and implement components of data science collaboration and deployment platform
• Develop automated, streaming data pipelines for event capture and transformation
• Work closely with Data Science and Analytics professionals
• Assist in feature extraction for the machine learning process

Requirements

• 5+ years in data-related field
• Experience with AWS cloud technologies such as S3 and EC2 instances
• Strong Python data skills with Pandas
• Strong SQL skills and ability to work with multiple relational technologies and NoSQL
• Ability to pick up new technologies quickly
• Production-oriented and committed to quality

Experience With The Following Technologies a Plus

• Redshift, Hive, Spark SQL
• Experience in additional languages such as Java or Scala
• ETL tools like Informatica or Pentaho
• Messaging systems such as Amazon Kinesis or Apache Kafka
• AWS technologies like Glue, DynamoDB
• Apache Spark or PySpark
• Workflow scheduling tools like Apache Airflow or Luigi
• Experience with third-party REST APIs and JSON data

Salary

• The pay range is from $60 to $80 per hour