Senior Data Engineer

We are partnering with a financial services client to hire Data Engineers to join a team working on large-scale data solutions.  This role involves working closely with project teams to manage data ingestion processes, prepare pre-stage files, and support multiple key project milestones.

You will:

• Prepare and manage pre-stage files for backbook conversion activities.
• Support and execute data ingestion tasks in alignment with scheduled project events, including key mock events.
• Monitor and ensure data ingestion completion within defined SLA windows.
• Troubleshoot and resolve ingestion issues promptly to maintain data integrity and project timelines.
• Maintain detailed documentation of ingestion processes, schedules, and completion statuses.
• Proactive problem-solving approach.

Requirements:

• 3+ years of experience with data engineering principles and working experience with data-driven decision-making platforms
• Experience in Python Development and PySpark
• 2+ years of experience working in large data environments
• Experience with data ingestion processes and ETL workflows.
• Experience with Snowflake or DataBricks 
• Expertise with high availability & distributed systems
• Experience working with a variety of AWS services 
• Experience with serverless architectures and Lambdas
• Experience with scripting languages (e.g., Python, Shell scripting) to automate data ingestion tasks is a plus.
• Familiarity with relational databases and querying languages such as SQL. 
• Strong attention to detail and ability to meet strict SLAs.
• Effective communication skills, with ability to coordinate across teams.

We are partnering with a financial services client to hire Data Engineers to join a team working on large-scale data solutions.  This role involves working closely with project teams to manage data ingestion processes, prepare pre-stage files, and support multiple key project milestones.

You will:

• Prepare and manage pre-stage files for backbook conversion activities.
• Support and execute data ingestion tasks in alignment with scheduled project events, including key mock events.
• Monitor and ensure data ingestion completion within defined SLA windows.
• Troubleshoot and resolve ingestion issues promptly to maintain data integrity and project timelines.
• Maintain detailed documentation of ingestion processes, schedules, and completion statuses.
• Proactive problem-solving approach.

Requirements:

• 3+ years of experience with data engineering principles and working experience with data-driven decision-making platforms
• Experience in Python Development and PySpark
• 2+ years of experience working in large data environments
• Experience with data ingestion processes and ETL workflows.
• Experience with Snowflake or DataBricks 
• Expertise with high availability & distributed systems
• Experience working with a variety of AWS services 
• Experience with serverless architectures and Lambdas
• Experience with scripting languages (e.g., Python, Shell scripting) to automate data ingestion tasks is a plus.
• Familiarity with relational databases and querying languages such as SQL. 
• Strong attention to detail and ability to meet strict SLAs.
• Effective communication skills, with ability to coordinate across teams.