This is a Principal Software Engineering position at Associate level which is part of the job family responsible for developing and maintaining software solutions that support business needs.
What you will do
Design, develop, and implement robustPySparkbased ETL frameworks with error handling and fault tolerance in distributed cluster environments.
Performdata enquiry,data analysisanddata sourcing inRelational and Big Data database environments.
Develop a thorough understanding of technology systems, data stores, data pipelines, job streams, and downstream data consumers.
Translate business requirements into data models andprogramdesign specifications
Modify ETL and related programs to implement changes driven by evolving business requirements
Respond to queries from business analysts and developers regarding data access, query design, and performance optimization.
Troubleshoot data issues and collaborate with data providers and upstream teams to identify root causes and drive resolution.Provide Level(L3) production support as needed.
Use AIenabled tools to accelerate data mapping, data lineage creation, and data profiling, improving turnaround time and overall data quality.
What you will bring
Experience withcoding in all:Pyspark, Python, SQL
Strong knowledge of relational databases and data modeling
Strong SQL query-writing skills
Strong analyticaland troubleshooting skills.
At least 5 years financial industrytechnologyexperience and knowledge of financial services data
Good verbal and written communication skills
Desired Skills:
Hands-onExperience withGraph Database/Stardog
Experience withcodingAutosysjob definitions
Experience with Data Modeling tools (e.g.,Power Designer)
Experience in LinuxShell
Experience inJava Development
Experience and Understanding of Data Quality Rules and Implementation
Expected base pay rates for the role will be between 90,000 and 150,000 per year at the commencement of employment. However, base pay if hired will be determined on an individualized basis and is only part of the total compensation package, which, depending on the position, may also include commission earnings, incentive compensation, discretionary bonuses, other short and long-term incentive packages, and other Morgan Stanley sponsored benefit programs.
