Software Engineer II Data

CDW Corporation • Full-time • Remote • $86k - $119k / year • 4d ago

Job Summary:

The Software Engineer II, Data builds and supports enterprise data ingestion, transformation, modeling, and integration solutions. This role translates business and source-system requirements into scalable, maintainable data solutions that support analytics, reporting, operational, and downstream application needs.

What you will do:

Build ingestion and transformation solutions using Microsoft Fabric and Azure Data Factory.
Implement pipelines supporting batch, incremental, API, file, database, and event-based integration patterns.
Develop reusable and configuration-driven ingestion and transformation patterns where appropriate.
Build curated data structures supporting analytics, reporting, operational, and downstream application requirements.
Work with structured and semi-structured data, including SQL, CSV, JSON, XML, Parquet, and similar enterprise formats.
Work with Azure Data Factory, Azure Data Lake/Storage and Azure SQL/SQL Server.
Translate business and source-system requirements into scalable data models.
Participate in conceptual, logical, and physical data modeling.
Design dimensional and curated models that support enterprise reporting and analytics.
Develop complex SQL queries, views, transformations, and data-processing logic.
Troubleshoot query, pipeline, and data-processing issues.
Perform query and pipeline performance tuning.
Identify and resolve data-quality, integrity, completeness, and consistency issues.
Perform source-to-target and source-to-source reconciliation.
Develop validation checks for new pipelines and changes.
Use GitHub for source control and branch-based development.
Follow EDAS CI/CD, pull-request, code-review and design-review standards.
Use Azure DevOps (ADO) and approved engineering practices to manage delivery.
Create maintainable, reusable, well-documented code.
Participate actively in peer code and design reviews.
Create or improve reusable engineering patterns and supporting documentation.
Monitor and support production data pipelines and scheduled workloads.
Troubleshoot pipeline failures, missed schedules, long-running processes, and data-quality issues.

What we expect of you:

Bachelor's degree in Computer Science, Information Systems, Data Engineering, Engineering, or a related field and 3 years of relevant IT experience, OR 7 total years of relevant IT experience.
Professional experience developing enterprise data pipelines, integrations, data warehouses, Lakehouse solutions, or analytics data platforms.
Demonstrated ability to troubleshoot complex data and integration problems.
Strong analytical and problem-solving skills.
Strong communication and cross-functional collaboration skills.
Ability to deliver effectively in an Agile enterprise engineering environment.
Strong SQL and relational database development.
Strong understanding of data engineering and ETL/ELT.
Microsoft Fabric.
Azure Data Factory (ADF).
Azure Data Lake / Storage.
Azure SQL / SQL Server.
Data warehousing and dimensional/data modeling concepts.
Data ingestion and transformation patterns.
Data validation and reconciliation.
Performance optimization and troubleshooting.
Git / GitHub.
CI/CD and pull-request-based development.
Azure DevOps / Agile delivery practices.
Python and/or PySpark, a plus.
Delta Lake / Lakehouse concepts, a plus.
Medallion architecture, a plus.
REST APIs / JSON-based integrations, a plus.
Event-driven integrations and Azure Service Bus, a plus.
Data migration and legacy-platform modernization, a plus.
Azure Key Vault and secure credential handling, a plus.
Enterprise data governance and data-quality concepts, a plus.
Microsoft Fabric / Azure data engineering certifications, a plus.