Information Technology - Principal Technologist, Data Engineering & Analytics (Scoot)

Job Summary

Information Technology - Principal Technologist, Data Engineering & Analytics (Scoot)

Job Description

The successful candidate will play a lead role within the Data Engineering and Analytics team within Scoot’s Information Technology Division.

Key responsibilities include:
• Provide technical leadership in data engineering for guiding Scoot’s data engineering and analytics team. Drive the overall technical vision and roadmap for evolving Scoot’s distributed data management systems and data analytics.
• Be an effective implementer and a technical mentor for the team in the following core activities:
- Design and develop new systems architecture for data engineering services and their ecosystem, spanning distributed databases (relational, columnar, graph, in-memory); DataOps; and other big data technologies.
- Maintenance and evolution of existing GCP cloud data warehouse/data lake system.
- Design data models for mission-critical and high-volume near-real-time and batch data; build idempotent/atomic production data pipelines to make data ingestion more robust and fault tolerant.
• Assist in the stakeholder management and resolve resource conflicts within or between agile teams. Lead projects involving high level of coordination among departments and business areas.
• Any relevant ad-hoc duties.

Requirements
• BS in Computer Science or other related discipline is required. Advanced degrees in Computer Science (PhD, MS) are highly desirable.
• 7 years or more relevant industry experience in the following technical areas:
- Advanced programming skills in Python. Conversant with data structures and algorithm design.
- Experience in building data pipelines (including data collection, warehousing, processing, analysis, monitoring, and governance) using data ingestion platforms.
- At least intermediate-level knowledge and experience with  GCP cloud components and best practices.
- Good understanding in deploying data stores such as S3, GCS and BigQuery.
- Prior experience in modern software development is required (such as web frontend UI, backend API microservices, understanding of CI/CD and Scrum/Kanban agile development).
- Experience with data ingestion platforms, including an in-depth understanding of modern ETL methodologies.
• Proven experience in technical leadership. Capable of mentoring a team in delivering on multiple competing priorities with little supervision. Seasoned resource estimation, planning, and negotiation skills to work with diverse stakeholders.
• Prior experience with managing software development teams using Agile/Scrum/Kanban methodology is a big plus.