Day to day Responsibilities:

1. Attending Scrum calls to provide daily status updates
2. Pickup assigned JIRA stories and work with Analysts or Product Owners to understand
3. Responsible for the development, maintenance, and enhancements of Data Engineering solutions of varying complexity levels across different data sources like DBMS, File systems (structured and unstructured) on-prem and cloud infrastructure; creates level metrics and other complex metrics.
4. Demonstrates Data Engineering skills (Spark Data Frame, Big Queries) by writing pipelines for business requirements.
5. Responsible for building, testing and enhancement of Data Pipelines solutions from a wide variety of sources like Kafka streaming, Big Query and File systems; develops solutions with optimized data performance and data security

Top skills:

• Spark Frame Work
• Kafka
• GCP
• Airflow
• Java/ Python/ Scala
• SQL

The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, paid time off, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, and paid holidays annually – as applicable.