In this role much of the focus will be on building out our Python/pyspark ETL processes and writing efficient SQL to build data lakes, data marts. Beyond technical expertise, this role will need skills for clearly communicating highly complex data topics to organizational leaders. Someone willing to willing to learn new technologies and assist senior data engineers in accomplishing work as a team.
Data Engineer - As a data engineer, you will be wear many hats, but much of the focus will be on building out our Python/pyspark ETL processes and writing efficient SQL to build data lakes, data marts. Beyond technical expertise, you will need soft skills for clearly communicating highly complex data topics to organizational leaders. Someone willing to willing to learn new technologies and assist sr data engineers in accomplishing work as a team.
Essential Job Functions:
- Gather data from primary and secondary sources, ensuring the up-to-date databases and data systems
- Work closely with our Product teams and data science team for easy and trusted data that provide unique insights into our data
- Build data pipelines that clean, transform, and aggregate data from disparate sources
- Develop data quality frameworks for ensuring data can be trusted
- Deploy data governance policies
- Use agile software development processes to make iterative improvements
- Define data work flows throughout the data system and to enable end to end of data analytics use cases implementation.
Qualifications/ Requirements:
- Four-year college degree or equivalent combination of education and experience
- Mid-level professional with 2-4 years of industry and/or relevant experience, typically at an Analyst level role or external equivalent.
- Three or more years of experience with Python, Pyspark, SQL
- Experience in building or maintaining ETL processes/Data lakes / Data warehouses
- Familiarity with the cloud ecosystem, specifically Snowflake/ Azure / AWS
- Communication skills, especially for explaining technical concepts to nontechnical business leaders
- Ability to work on a dynamic, research-oriented team that has concurrent projects
Special Requirements:
· The employee may be required to report to a different local office as a normal, contemplated, and mandated incident of their employment
Note: This job description is not intended to be all inclusive or exclusive. At any time, employees may perform other related duties as required to meet the ongoing needs of the organization and participate in additional trainings.