Skip to main content

AWS Data Engineer with Python and PySpark

AWS Data Engineer with Python and PySpark
Diverse Lynx
remote
8 months 1 week ago

Job Description

· Knowledge in Terraform, S3, API Gateway, Lamba, SNS and SQS.

· Should have wide experience in AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM, Node JS, Glue ETL.

· Should have CICD experience using tools like GIT, Jenkins etc.

· Should have extensive hands-on experience with SPARK and real-time analytic frameworks, data streaming & Structured streaming.

· Knowledge in Databricks reporting.

· They need to be experienced in programming language (Python, Pyspark).

· Hands-on experience integrating open-source components into data-analytic solutions.

· Working with vendors to enhance tool capabilities to meet enterprise needs.

· Willingness to continuously learn & share learnings with others.

· Strong troubleshooting and performance tuning skills.

· Experience building multi-tenant, virtualized infrastructure a strong plus.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

Diverse Lynx

Expertise level

Work arrangement

Key skills

Similar Jobs in United States

Similar Jobs in Connecticut