Day to day:

• Creating ETL processes
• PH has legacy systems and Databases, would need to maintain them
• Migrate those SQL server to other servers – upcoming work
• Write auto scripts using Python
• Work is purely creating data pipeline, person will mostly work on Azure cloud, sql, data factory
• Large amount of data, and not going to move right away, but have ongoing projects that are cloud based.
• There are 5 SQL server, Salesforce, API as well.
• Validating the data. Once they create pipeline,  have to validate and test pipeline
• Train quantitative analysts at PH to consume data and data storage efficiently. They currently grab whole data base, play with it in R, then dump back in database. Data team itself is very good at dealing with data, moving it around, being efficient with storage, so they need to teach others outside of team to be better
• PowerBI and Analytics – Responsible for creating diff visualization for the org, write power queries
• May be assigned to work separate projects
• Cross-team work. Will have BA team that will speak to stakeholder, but once in awhile will communicate directly with them
 

Must-haves/key skills needed

• 5+ years experience:
• Python, PySpark, Azure Data Factory, SQL , Glove storage, Snowflake, Azure Cloud Services
• ETL tools: Data Factory, Data Bricks, PySpark
• Object oriented – C# and Python
• Big data - Hadoop spark
• Knowledge on PowerBI and Analytics

Plusses/education/certifications

• Cosmos Data base (good to have)
• Certifications
• Kafka - not using at moment but that will be introduced later for Real time Data

 Salary range: $10000-$11000/year with benefits