Data Engineer Save

POSITION SUMMARY

Second Harvest Heartland is seeking a passionate and driven Data Engineer to join our Data and Analytics team. In this critical new role, you’ll build and maintain data pipelines to ensure seamless integration and transformation of data from diverse sources into our MS Fabric data warehouse to aid in our mission to fight hunger across Minnesota. The ideal candidate possesses a deep understanding of data engineering, data integration, and cloud technologies. If you’re passionate about data, thrive in a collaborative environment, and are eager to contribute to social impact, this may be the perfect opportunity for you!

DUTIES AND RESPONSIBILITIES:

 Data Pipeline Development

• Architect and build data pipelines to extract, load, and transform data from multiple sources into the data warehouse.
• Continuously optimize and fine-tune data pipelines for performance and scalability, implementing best practices.
• Develop automation scripts or use CI/CD (Continuous Integration/Continuous Deployment) pipelines to automate deployment and management of data pipelines.
• Conduct regular performance analysis and troubleshooting to identify bottlenecks and optimize pipeline efficiency.

Data Modeling

• Lead efforts to design data models and build curated data sets for reporting and analytics.
• Maintain the semantic layer of data modeling, defining and managing metrics, dimensions, and joins for consistent and accurate reporting.

Documentation and Governance

• Document source to target, data lineage, definitions, and usage guidelines to promote data literacy across the organization.
• Partner with data stewards and custodians to ensure data quality, security, and governance, adhering to our dedication to responsible and ethical use of data.
• Own the design, monitoring, and deployment of certified data sources in the data warehouse that will be leveraged by our PowerBI reporting platform.

Collaboration

• Collaborate with the Data and Analytics team to understand their data needs and translate them into effective data pipelines, models, and metrics.
• Work closely with stakeholders to gather and analyze data requirements, translating them into technical solutions that meet business needs.
• Support data consumers in their use of BI tools to connect and consume data from the data warehouse.

ESSENTIAL QUALIFICATIONS:

Education and Experience

• Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field.
• 5+ years of experience in data engineering, focusing on data integration and transformation.

Technical Skills

• 2+ years of experience modeling and normalizing operational data.
• Solid understanding of relational databases, SQL, and warehousing concepts.
• In-depth knowledge and hands-on experience with data modeling techniques and ETL processes.
• Proficiency in data modeling approaches and philosophies such as Kimball, Inmon, or Data Vault.
• Experience in designing, implementing, and optimizing ETL pipelines for data integration and transformation.
• Familiarity with the Microsoft Fabric or Azure ecosystem (e.g., Data Factory, Synapse Analytics, Azure SQL Database, etc.).
• Experience using pipeline orchestration tools.
• Skilled in applying software engineering principles (e.g., testing, version control, code reviews, CI/CD).
• Proficiency in data query and analysis tools (e.g., SQL, Microsoft PowerQuery, Excel, Power BI).
• Strong understanding of data sourcing, integration, and transformation into actionable insights.

Programming Skills

• 5+ years of professional experience using data manipulation languages (e.g., SQL, Oracle PL/SQL)
• Expertise in writing scalable SQL, particularly in ELT data pipelines.
• 3+ years of experience building data pipelines and scripting.

Analytical and Problem-Solving Skills

• Strong problem-solving skills and attention to detail.
• Ability to interpret business needs and develop appropriate data solutions.

Project Management

• Ability to prioritize projects based on organizational needs.
• Strong time-management skills with the ability to meet deadlines and manage quick turnarounds.

Communication and Collaboration

• Strong written and verbal communication skills with the ability to explain technical concepts to both technical and non-technical audiences.
• Desire to work collaboratively and foster teamwork.

Self-Directed Learning

• Proactive in seeking resources and opportunities to improve skills and methods.
• Demonstrated interest in advancing data infrastructure and data analytics applications.

DESIRED QUALIFICATIONS/NICE TO HAVE:

• Non-profit experience
• Experience with complex data infrastructures, cloud warehouse, APIs
• Experience with any: Oracle NetSuite, Waerlinx, ServiceNow, Raiser’s Edge NXT, Luminate Online, Galaxy Digital, or Bonterra
• Familiarity with statistics and predictive modeling concepts
• Understands and can execute the steps required to deploy a trained model into a production environment

BEHAVIORAL EXPECTATIONS IN ALIGNMENT WITH OUR VALUES:

• We Deliver:  We use our head and heart to make decisions, we make the best use of donor dollars, and we achieve results safely and reliably.  
• We Lead with Our Hearts:  We keep our neighbors, partners, and teams at the center of our work. We seek to understand and anticipate their needs.  
• We are all in this Together:  We collaborate, internally and externally. We communicate openly, seeking feedback and sharing knowledge. 
• We Innovate:  We seek out bold new ideas, we embrace change, and we commit to continuous improvement for ourselves and our work. 
• We Believe our Differences Make us Stronger:  We are curious about and embrace cultural differences. We build teams that reflect our community.  

REPORTING TO THIS POSITION: