Data Engineer (Cloud)

Contract: Chicago, Illinois, US

Salary: $70.00 Per Hour

Job Code: 354032

End Date: 2024-10-19

Days Left: 28 days, 13 hours left

Job Title: Data Engineer (Cloud)
Location: Remote Role
Duration: 3+ Months Contract Role (End of the year) + Extension
Pay Range: $65/hr to $70/hr

Job Description:
The Senior Data Engineer will design, code, test, and analyze software programs and applications. This includes researching, designing, documenting, and modifying software specifications throughout the production lifecycle. This role will also analyze and amend software errors in a timely and accurate fashion and provide status reports where required. The position responsibilities outlined below are not all encompassing. Other duties, responsibilities, and qualifications may be required and/or assigned as necessary. Responsibilities:
 
  • Work with Product team to determine requirements and propose approaches to address users' needs
  • Analyze requirements to determine approach/proposed solution
  • Design and Build Solutions using relevant programming languages
  • Thoroughly test solutions using relevant approaches and tools
  • Conduct research into software-related issues and products
  • Bring out-of-box thinking and solutions to address challenging issues
  • Effectively prioritize and execute tasks in a fast-paced environment
  • Work both independently and in a team-oriented, collaborative environment
  • Flexible and adaptable to learning and understanding new technologies
  • Highly self-motivated and directe
    Must have skills:
  • Strong verbal and written communication skills
  • Demonstrate integrity and maturity, and a constructive approach to challenges
  • Demonstrate analytical and problem-solving skills, particularly those that apply to Data Warehouse and Big Data environments
  • Open-minded, solution-oriented and a very good team player
  • Hands-on experience in developing Data Lake and Data Warehouse and Data Marts
  • Experience in industry-standard ETL/ELT tools
  • Hands-on experience with AWS cloud architecture and development using AWS resources like S3, Lambda, API Gateway, RDS, etc
  • Proficiency in relational databases (Snowflake, Redshift, etc), database concepts and dimensional modeling
  • Experience in data cleansing, data validation and data wrangling
  • Proficiency in SQL and Scripting (Unix sell scripts, Python)
  • Hands-on experience in troubleshooting complex ETL and SQL problems
  • Hands-on experience in designing and building data pipelines in AWS cloud using S3, Lambda, API Gateway, RDS, Redshift, etc.
Good to have Skills:
  • Experience in data pipeline development using ETL tool, Informatica IICS
  • Experience in scripting languages, Unix scripting and Python
 
 
TECHNICAL QUALIFICATIONS:

 

  • 6+ years of experience within the field of application/platform engineering or related technical work including business intelligence, and analytics.
  • 4+ years of experience with AWS Senior Cloud Data Engineering, management, maintenance, or architecting, implementing best practices and industry standards.
  • Experience with data warehousing platforms such as Snowflake, Redshift or similar.
  • Strong knowledge and established experience with AWS services including but not limited to: S3, EC2, RDS, Lambda, Cloud Formation, Kinesis, Data Pipelines, EMR, Step Functions, VPC, IAM, and Security Groups.
  • Experience with DataBase technologies (e.g., SQL, Python, PostgreSQL, AWS Aurora, AWS RDS, Mongo DataBase, Redis).
  • Experience with CI/CD tools, pipelines, and scripting for automation. (GitHub Actions, Jenkins, AWS Code Pipeline tools, Cloud formation, and Terraform).
  • The high degree of knowledge of IAM Roles and Policies
  • Strong knowledge of configuring AWS cloud monitoring and alerts for cloud resource availability.
  • Strong scripting experience using PowerShell and/or Python.
  • A high degree of knowledge in PaaS and SaaS application performance.
  • Understand enterprise-level application architecture diagrams and IT security requirements.
PREFERRED EXPERIENCE:

 

  • Experience with large-scale enterprise streaming services such as Kafka.
  • Experience with Kubernetes and Docker containers or AWS Fargate.
  • Experience implementing applications with both Windows and Linux server OS
  • Experience with networking, security groups, or policy management in relation to Cloud resources across multiple operating systems, including UNIX, Linux, or Windows
  • Advanced CS degree.
 
Thank you
Job Requirement
  • Data Warehousing
  • Data
  • Big Data
  • AWS
  • Cloud
  • Snowflake
  • Redshift
  • Redis
  • SQL
  • Python AWS Aurora
  • CI/CD
  • Pipelines
  • Cloud Formation
  • Terraform
  • IICS
  • Scripting
Reach Out to a Recruiter
  • Recruiter
  • Email
  • Phone
  • Parth Shah
  • parth.rshah@collabera.com
Apply Now
Apply Now
close-icon

©2024 Collabera. All rights reserved.