Job Description

As a Principal Data Platform Engineer, you will be responsible for driving key data platform initiatives, including data ingestion, processing, storage, and querying. The role involves building scalable systems and services, collaborating with stakeholders, and contributing to the Data Platform vision.

Responsibilities

• Define and plan the long-term strategy for Data Platform
• Design and develop scalable distributed systems for data management
• Address fault-tolerance and high availability issues
• Scale ingestion pipelines and improve ETL framework
• Collaborate with engineers to deliver cross-functional features
• Participate in the software development life cycle

Requirements

• 10+ years of software engineering experience
• Backend programming skills including multi-threading and concurrency
• Proficiency in Python or similar languages
• Strong CS fundamentals
• Experience in designing and operating scalable systems
• Experience with technologies like Apache Kafka, Apache Spark, Airflow, and Kubernetes
• Excellent troubleshooting skills
• Experience with containerized platforms like Docker and Kubernetes
• BS in Computer Science or a related field (Masters preferred)
• Excellent verbal and written communication skills

Benefits

• No benefits