Who we are looking for
We are seeking a Data Engineer for Cloud Data Lake activities. The ideal candidate should have industry experience, preferably in Financial Services, supporting enterprise applications, with exposure to Cloud-based Data engineering platforms. This role involves partnering with senior development managers, architects, and business leadership to develop and execute the technology product roadmap and implement Data Governance policies.
What you will be responsible for
Collaborating with cross-functional teams to understand project requirements, user stories, and translating them into functional and technical specifications.
Documenting requirements for manual and automated testing of AWS-based applications, Databricks, and ETL backend systems using Java and Selenium.
Designing, developing, and maintaining automated test scripts to ensure efficient regression testing and comprehensive test coverage.
Executing performance tests to evaluate system scalability, reliability, and efficiency.
Analyzing and documenting Business Requirements, Functional Requirements, Data flows, Business rules, Data mapping, Use cases, and Traceability Matrix.
Translating business needs into functional/technical requirements, with experience in Data Analysis, Data Mapping, Requirements Gathering, and Data Visualization.
Building intuitive data visualization dashboards/reports and analyzing data insights using visualization tools.
Identifying opportunities to improve system efficiency and scalability, focusing on data structure and process improvements.
What we value
Skills that will help you succeed include:
Proficiency in Python, Scala/PySpark, PL/SQL, PERL/Scripting.
Experience as a Data Engineer supporting Cloud Data Lake activities, with familiarity in navigating enterprise Cloud applications using distributed computing frameworks such as Apache Spark, Hadoop, and Hive. Industry experience in Financial Services is preferred.
Knowledge of database performance optimization, scalability, data security, and compliance.
Education & Preferred Qualifications
Bachelor's or Master's Degree in Computer Science, Engineering, Math, or equivalent experience.
8+ years of professional experience in software design and development.
Strong analytical skills for quick and independent information analysis.
Proven ability to develop and manage cross-functional processes and project timelines.
Excellent attention to detail, follow-through, and time management skills.
Ability to manage multiple tasks effectively in high-pressure, deadline-driven environments.
#J-18808-Ljbffr
