Overview
This role is responsible for the quality assurance and stewardship of data, planning, designing, and completing data list pulls and upload routines, and proactively monitoring, measuring, analyzing, and reporting on data quality issues. The Data Engineer will provide ongoing support, training, and documentation to global teams to help them capture and extract high-quality information for analytical decision-making.
Tasks Summary
- Perform Data List Pulls from ER data using Azure MSSQL, Databricks, and Salesforce based on stakeholder or vendor requirements.
- Extract, transform, and load (ETL) data from vendor sources such as SFTP or portals into Azure MSSQL and subsequently into Databricks, Salesforce or other key marketing technology platforms.
- Develop and automate recurring data processing operations to optimize efficiency.
- Create, maintain, and update Excel VBA templates for partners, ensuring usability and alignment with project requirements.
- Develop and maintain database code in the form of Stored Procedures/Notebooks, SQL Queries. Functions and Views as required by business processes.
- Ensure system optimization, by improving and restructuring databases. Involved with all levels of database management.
- Perform database updates and migrations.
- Design, implement, and maintain data upload workflows to ensure seamless integration from external sources into the IRC’s data architecture.
- Ensure efficiency of database code, integrity of data structures, quality of data content and database code is accurately documented.
- Work closely with other team members to make sure database code meets the requirements.
- Experience building data-warehouses (relational and non-relational databases) and solutions for CRM (Salesforce)
- Write database queries and code while maintaining data quality, privacy, and security.
- Responsible for requirement gathering, bug fixing, testing, documenting, and implementation.
- Collaborate with partners to refine templates and provide sophisticated and strategic support.
- Monitor and enhance database performance and design to support operational efficiency.
- Identify and resolve data inconsistencies, errors, and exceptions using sophisticated SQL queries and strong analytical thinking.
- Work closely with cross-functional teams to deliver solutions that meet business needs.
- Act as a subject matter expert for database processes, data handling, and automation tools.
- Conduct unit testing to validate data workflows, troubleshoot defects, and implement necessary fixes.
- Document processes, workflows, and resolutions to maintain a knowledge base for future reference.
- Build productive relationships with internal partners and vendors to align on data requirements and project goals.
- Communicate proactively to provide updates, resolve challenges, and deliver technical/admin support.
- Review, assess, and resolve database-related Salesforce cases submitted by partners.
- Provide technical support and solutions addressing data pull/upload issues, automation challenges, and other Salesforce data handling needs.
Experience Requirements
- 5+ years hands on with Data Management including data extraction, transformation, and loading (ETL).
- Significant demonstrable professional work experience with CRM and relational databases (non-profit experience a plus) and IT delivery, IT services, and professional services environments.
- Experience creating database structures and implementing quality checks to ensure CRM data integrity.
- Hands-on experience with creating database objects such as views, stored procedures, and functions.
- Advanced knowledge of SQL database development, query performance tuning, and sophisticated data manipulation.
- Proficiency in Databricks, DBT, MongoDB, and MSSQL queries with DBAmp for Salesforce data integration.
- Exceptional analytical and problem-solving skills with attention to detail and data accuracy.
- Ability to independently handle multiple projects and high workloads while meeting deadlines.
- Excellent oral and written communication skills, with the ability to translate technical concepts for non-technical audiences.
- Strong customer service orientation with a proactive approach to partner collaboration.
- Experience with Salesforce NPSP (Nonprofit Success Pack)
- Sophisticated knowledge of MS Office VBA for process automation and template creation.
- Certification for Databricks is a plus.
- Hands-on experience with ETL design sessions and workflows.
- Experience in supporting fundraising applications for non-profit organizations.
- Experience in working optimally with an Agile delivery model.
- Experience with web services or application programming interfaces a plus;
- Experience in implementing business intelligence and data warehouse solutions.
Qualification Requirements
- Minimum: Associate’s Degree
- Preferred: Bachelor’s degree in Computer Science, Information Technology or Engineering or equivalent experience.
