Senior Data Platform Engineer

Job title:

Senior Data Platform Engineer

Company

NewDay

Job description

Senior Data Platform EngineerJob no: 502548
Work type: Permanent Full Time
Location: London – Hybrid
Categories: Data Architecture & Data EngineeringYour New RoleAs a Senior Data Platform Engineer specializing in Snowflake, you will lead the architecture, design, and implementation of our data warehouse in a multi-tenant environment. Collaborating with Platform Engineers, Technical Architects, Data Engineers, and Analysts at NewDay and with B2B customers, you’ll ensure that the platform’s performance, reliability, and security meet the needs of multiple teams.Why Join NewDayAt NewDay, you will be at the forefront of transforming the credit landscape. Our commitment to innovation offers you the chance to work with the latest technologies, including cloud computing, data analytics, and advanced automation tools. You’ll play a crucial role in shaping our data infrastructure and delivering solutions that impact millions of customers.What You’ll Deliver in the First 0-12 Months

• Design and Build: Create and manage a Snowflake data ecosystem to support event and batch workflows, enabling end-user teams to access data, perform transformations, build reports, and leverage automation tools.
• Process Automation: Ensure processes are automated, observable, and compliant with platform standards.
• Schema Management: Enhance and maintain a Squitch project for Snowflake schema management.
• Library Maintenance: Maintain and enhance a Python library for end-user data access in Snowflake and S3.
• Administration: Manage Snowflake and associated tooling accounts, including user and permission management (IAM, AD).
• Airflow Support: Collaborate with users to write and support Airflow DAGs hosted in Astronomer Cloud.
• Streaming Data: Work within a streaming data ecosystem, such as Kafka.
• Analytics Integration: Integrate visualization and analytics tools like PowerBI and Tableau.

What You’ll Bring – Essential Skills

• Proficient knowledge of Snowflake (Columnar databases), Jupyter notebooks, Airflow, and Docker.
• Strong Python and SQL coding abilities.
• Familiarity with distributed systems, APIs, and cloud computing patterns.
• Understanding of virtualization/containerization.
• Experience with EKS/Kubernetes and DevOps tools, particularly GitHub Actions.
• Understanding of AWS infrastructure and services (S3, EKS, IAM, Storage Gateway, Athena).
• Proficient in Terraform or a solid understanding of Infrastructure as Code (IaC).

Desirable Skills

• Expertise in Snowflake concepts such as resource monitors, RBAC controls, virtual warehouse setup, query performance tuning, and time travel.
• Experience with Kafka and DBT.
• Understanding of Data Vault design patterns and cloud/network configurations (Firewalls, Proxies).
• Familiarity with AWS networking (VPC, VPN, Direct Connect, Route 53, Auto Scaling, CloudWatch, GuardDuty).

Our Dynamic NewDay CultureAt NewDay, we’re dedicated to driving impact and nurturing creativity. We offer a competitive salary with performance-based bonuses and a comprehensive benefits package, including:

• Generous Leave: Enjoy 26 days of holiday, with options to purchase additional days for a balanced work/life schedule.
• Flexible Work Environment: Tailor your work setting with our hybrid working approach, whether in the office or remotely.
• Free Healthy Meals: Benefit from complimentary healthy meals in the office to promote wellbeing and collaboration.
• Wellbeing Initiatives: Access mental health resources and green transport schemes, supporting a sustainable lifestyle.

We celebrate diversity and are committed to creating an inclusive environment where all voices are heard. If you require any accommodations during the application process, please let us know.Join us at NewDay to make a meaningful impact, grow your skills, and be part of an innovative team dedicated to driving change in the credit industry.#LI-MD1#LI-HybridAdvertised: 20 Dec 2024 GMT Standard Time
Applications close: 30 Jan 2025 GMT Standard Time

Expected salary

Location

London

Job date

Mon, 23 Dec 2024 23:55:49 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (jobsnear.net) you saw this job posting.