Data Engineer- SQL
Apply on
Strategic Analytics is a growing team at Arch. The team develops innovative predictive models and analytical tools to improve profitability and growth. This position will help support the data engineering needs across a growing portfolio of high-profile analytics projects by developing complex data structures and pipelines leveraging a diverse set of tools and languages. This includes the following cloud based technologies: Databricks, Snowflake, Spark, Python and Azure Data Factory. As a key member of the Strategic Analytics team, you will advance our data engineering capabilities helping the team analyze data faster.
Responsibilities
- Work closely with predictive modelers to assemble large, complex data sets that help solve business problems and increase profitability
- Perform data manipulation and transformation using SQL and Python
- Identify, design, and implement internal process improvements: automating manual processes and optimizing data pipelines
- Discover and explore new sources of data with curiosity and creativity
- Create and maintain optimal data pipeline architecture
- Author detailed and comprehensible documentation of data pipelines and technical solutions
- Ensure data quality and completeness
Required Skills/Experience
- Advanced working SQL knowledge and experience working with relational databases, query authoring
- A successful history of manipulating, processing and extracting value from large, disconnected datasets
- Ideally, 3+ years of experience in a Data Engineer role or equivalent using SQL and/or Python
- Experience with cloud technologies and Python is a plus
- SSIS
- Azure Data Factory
Education
BS in Computer Science, Information Technology degree, Data Analytics or equivalent