Bigdata Architect

3Pillar
Full-time
United States
$120,000 - $165,000
Posted on 5 months ago

Job Description

Join 3Pillar as a Data Architect to define and implement data management, business intelligence, and analytics solutions for clients. This role involves working with business leaders and information management teams to create roadmaps for data-driven solutions.

Responsibilities

  • Assess existing data components and perform POCs
  • Propose end-to-end solutions for data-specific business problems
  • Design large data platforms for data engineers, analysts, and scientists
  • Define tools and technologies for automated data pipelines, ETL processes, dashboards, and reports
  • Reassess current state for alignment with architecture goals and business needs
  • DB modeling, data storage decisions, and documentation
  • Ensure performance, reliability, reusability, resilience, scalability, security, privacy, and data governance
  • Apply best practices in architecture, coding, API integration, and CI/CD pipelines
  • Coordinate with data scientists, analysts, and stakeholders
  • Mentor junior team members and lead initiatives
  • Provide thought leadership

Requirements

  • Expertise in SQL, Python, ERD, GCP (BigQuery, GCS, Cloud Function, Composer), and DBT
  • Experience with Big data (100TB+)
  • Knowledge of Modern Data Technology
  • Design and optimize database models
  • Extensive experience in data modeling
  • Implement data strategies and ensure efficiency and security
  • In-depth understanding of database structure principles
  • Expertise in implementing and maintaining data pipelines
  • Deep knowledge of data mining and segmentation techniques
  • Familiarity with data visualization tools

Benefits

  • No benefits