- Posted 19 days ago | Updated 23 hours ago
Overview
On Site
Contract - W2
Contract - 6-12 Month(s)
Skills
Python
Pyspark
Cliecon Solutions Inc, (headquartered in central NJ) is one of the fastest growing and a leading consulting and management firm with 12 years of experience in Staff Augmentation. We handle the complete recruiting cycle for Fortune 500 clients, major implementing partners, and tier-1 vendors. We specialize in recruiting for Application development, Big data, Databases, Infrastructure, Cloud, Mobile, and ERP-based solutions projects.
Job Title: AWS Data Engineer
Location: Chicago IL
Duration: 6-12 Months
Job description:
Typical duties and responsibilities:
- Design and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and S3.
- Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes.
- Create and manage applications using Python, SQL, Databricks, and various AWS technologies.
- Quickly develop innovative Proof-of-Concept (POC) solutions and services to address emerging needs.
- Provide Run/DevOps support and manage the ongoing operation of data services.
- Automate repetitive tasks and build reusable frameworks to improve efficiency.
- Collaborate with teams to design and develop data products that support marketing and other business functions.
- Ensure our data services are reliable, maintainable, and seamlessly integrated with existing systems.
Required skills and experience:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 10+ years of experience with AWS services including S3, Lambda, API Gateway, and SQS.
- 7+ years of experience with data processing tools like Spark, Hive, Kafka, and Airflow.
- Strong skills in data engineering on AWS, with proficiency in Python.
- Experience with batch job scheduling and managing data dependencies.
- Knowledge of DevOps automation tools like GitLab, Bitbucket, Jenkins, and Maven.
#J-18808-Ljbffr