Developer - Data Engineer

At Duke Health, we're driven by a commitment to compassionate care that changes the lives of patients, their loved ones, and the greater community. No matter where your talents lie, join us and discover how we can advance health together.

About Duke Health Technology Solutions

Pursue your passion for caring and innovation with Duke Heath Technology Solutions, which is dedicated to the transformation, development, and management of enterprise information technology solutions across Duke Health.By harnessing the power of innovative technologies like cloud computing and artificial intelligence - and pairing them with a forward-thinking approach - Duke Health Technology Solutions is revolutionizing the future of health care at Duke Health and beyond.

Primary Role

The DHTS Developer is tasked with designing, developing, and optimizing databases and ETL pipelines, as well as managing servers and integrating APIs. This role involves working closely with data scientists and analysts to address data needs and implement effective data management solutions.

This role will assist with building data assets in Microsoft Fabric for use in Power Bi. This includes building data models and semantic models.

The ideal candidate should also have experience in web application development using ASP.NET, JavaScript/jQuery, and CSS, along with familiarity with Git/GitHub and DevOps practices.

Level 1 Work Performed, at a minimum

* Individual contributor works under the direct supervision of level 3 or above and collaborates as a member of a team

* Basic understanding of local databases (Clarity; Caboodle) and underlying tables pertaining to role/domain

* Basic understanding of ETL technologies and scripting languages and terminology related to role

* Basic understanding of cloud data engineering technologies, including storage accounts, data pipelines,

data lakes, structured vs. unstructured data, etc.

* Ability to design, construct and test data management systems under guidance of senior team members

* Assists in server administration tasks, ensuring system performance and availability

* Basic knowledge of SQL and relational databases

* Follows all policies and procedures set forth by DUHS/DHTS/ACE as pertains to role

* Responds to customer requests for assistance as assigned and prioritized by manager

* Participates in code review and learning best practices in data engineering

* Maintains ongoing communications (timely, clear, concise, and accurate) with manager keeping them apprised of request status

* Maintains appropriate project documentation as assigned such as GITLAB or data dictionary

Level 2 Work Performed, at a minimum

* Meets all Competencies in Level 1 AND:

* Works with new hires/Level I team members to train on use of tools and technologies to accomplish job duties

* Demonstrates advanced knowledge of the assigned domain/role. Understands data, workflows, and tools related to role.

* Demonstrates advanced knowledge of, and experience with, cloud data engineering concepts, including

(but not limited to) Microsoft Azure Lakehouses and Delta Tables, Azure Data Factory, Azure Synapse, and medallion-style data architecture.

* Demonstrates ability to work with stakeholders to understand business needs and perform business analysis independently >75% of the time.

* Develop technical requirements from business requirements independently >75% of the time.

* Can write/modify accurate SQL queries independently > 90% of the time

* Ability to optimize SQL queries, stored procedures and scripts for performance reliability

* Can write complex SQL inclusion/exclusion criteria for cohort development

* Manages and optimizes server infrastructure for performance and reliability

* Troubleshoot and resolve complex data pipeline, server and API issues

* Ability to locate data elements independently > 75% of the time

* Knowledge/utilization of basic data design and infrastructure

* Participates in team code review

* Actively participates/contributes to database QA/submit requests for new database tables/attributes

* Actively seeks outparticipationin Special Projects and is able to effectively accomplish project assignments with minimal supervision

* Ability to manage multiple projects to completion in a timely manor

* Ability to develop and present topics as assigned/needed by customer and/or ACE team

* Active participation in Duke Analytic Community or other networking forums applicable to job functions

Level 3 Work Performed at a minimum

* Meets all Competencies in Level 2 AND:

* Demonstratesexpertise insystems and software related to project area to accomplish job duties (e.g.

SSIS, Azure Data Factory, etc..)

* Resolves escalated issues/incidents to ensure high availability and performance of ETL processes

* Architects and designs robust data solutions

* Expert knowledge and experience with Microsoft Azure Data Engineering tools, concepts, and industry

best practices.

* Expert locating data elements as required. Assists team in locating data elements as needed.

* Works with team members to train on advanced skills in using tools and technologies to accomplish job duties

* Leads the development of complex data pipelines and API integration, ensuring scalability and efficiency

* Defines standards and best practices for data pipeline design, development and maintenance

* Demonstrates ability to work independently to solve problems and complete assigned work >95% of the time

* Demonstrates ability to work with customers to understand business need or problem to address

independently >95% of the time

* Leads Projects with minimal supervision

* Change agent with regard to team processes, workflows when issues/gaps are found

* Collaborates with data architect on design and implementation of data solutions (lakehouse, data

warehouse, etc.)

* Serves as moderator, leader or channel owner for a forum such as Duke Analytics Community or other professional networking organization

Behaviors/Soft Competencies:

Advancement to the level 3 or above requires employee, at a minimum, successfully attain the following:

The following measures can help create a fair and comprehensive evaluation process for promotions, ensuring that the most deserving employees are recognized and given opportunities to advance.

* Proven ability to work at the next level: This involves demonstrating the skills and competencies required for the next level of responsibility. Employees should have demonstrated that they can handle tasks and challenges that are typically associated with a higher position.

* Potential to serve beyond the next level: This measure looks at the employee's long-term potential and their ability to grow within the organization. The employee should have the vision, ambition, and capability to take on even greater responsibilities in the future.

* Consistently demonstrates a values-based approach in how they work: Employees should consistently exhibit behaviors and decision-making processes that align with DUHS values. The exhibited values are integrity, teamwork, diversity excellence and safety. Patient-focused is also critical to success.

* Is considered one of the top performers at their level across the organization: This measure evaluates the employee's overall performance and reputation within DHTS. Top performers are often recognized for their exceptional contributions, reliability, and ability to exceed expectations. We will select the best and not the best available.

Required Qualifications at this Level

Education/Training

Bachelor's degree in a related field, or four years of equivalent technical experience required.

LICENSURE/CERTIFICATION:

None required. Preferred certification in development technologies, as appropriate for the position.

Experience

Level 1 - No experience required beyond the minimum education (or equivalency) requirement.

Level 2 - Two years of directly related experience is required.

Level 3 - Four years of directly related experience is required.