View all jobs
Director, Data Engineering
Virtual, RemoteJPC is looking for a Director, Data Engineering that will lead a team that performs a critical function for the direct-response marketing agency: managing the ingestion of donor and transaction data from hundreds of clients into an intricate data ecosystem. You will have the responsibility of overseeing the data infrastructure, ranging from on-premise Microsoft SQL Server to Snowflake in AWS, as well as IBM iSeries Db2.
Responsibilities:
Responsibilities:
- Own the maturation of the ETL pipelines' code development lifecycle
- Oversee the administration of our data environment including the data lake, which uses API connectors to sync tens of millions of client data records per day
- Develop, implement, optimize, and support data pipelines in systems such as Knime, dbt and SSIS
- Manage and mentor a team of data engineers and a team of data coordinators
- Drive efficiency and cost-savings by standardizing and unifying technologies, centralizing error reporting, and scaling operations
- Work closely with internal stakeholders, balancing their expectations with the capabilities of our data environments and capacity of the engineering team
- Work in collaboration with the product development department to shape the feature and functional needs of new data systems
- Support CRM data implementations and the data integration needs of CRM customers
- Oversee monitoring of ETL processes to resolve immediate issues and understand root causes for permanent solutions
- Extensive experience in data management and data engineering, working with various data models, RDBMSs, and ETL tools
- Strong proficiency in SQL, with a deep understanding of query optimization, data modeling, and database design
- Strong background in data transformation, with proficiency in Python and dbt preferred
- Hands-on experience with data pipeline development in KNIME (or similar tools like Tableau, Alteryx, MATLAB, SAC (SAP Analytics Cloud), Qlik, etc.), dbt and SSIS
- Exceptional leadership, communication, and interpersonal skills
- Proven ability to quickly gain context, prioritize tasks, and manage urgent needs
- Experience managing a backlog of work, prioritizing, and assigning tasks, and managing team’s capacity
- Experience in managing a data-focused team and a keen ability to nurture their development