View all jobs
Data Engineer
Audubon, PAThe primary function of the Data Science Engineer is to provide expertise in developing solutions and models for operations forecasting in the Markets Coordination Department. The Markets Coordination department directly supports Dispatch Operations in real time operations and forecasting. The Markets Coordination department provides critical information such as day-ahead load and renewable information and forecasts that influence the operating plan. The data science function will develop performance metrics and improvement strategies including but not limited to developing or enhancing models and assisting the team in evaluating potential solutions.
Responsibilities:
Responsibilities:
- Identifying, creating, and preparing data required for analysis and visualization
- Assuring that data is cleansed, mapped, transformed, and optimized for storage and use according to business and technical requirements
- Automating tasks and deploying production standard code
- Loading transformed data into storage and reporting structures such as data warehouses, real-time reporting systems and analytics applications
- Building data models and an understanding of learning algorithms
- Minimum 5 years of relevant experience; 7+ years of relevant experience preferred
- Experience in data engineering
- Experience building and optimizing 'big data' data pipelines, architectures, and data sets
- Knowledge of SQL and Python/PySpark
- Open mindset, ability to quickly adapt to new technologies and learn new practices
- Knowledge of Oracle PL/SQL, Java is a plus
- Performance/security-oriented data modeling and data design, including partitions, different type of indexes, views, and most effective data management practices
- Azure Synapse Analytics, Azure DevOps
- Knowledge of Purview, Snowflake, Qlik, or Tableau is a plus
- Bachelor’s Degree in Data Engineering, Data Science or Computer Engineering