Senior Director, Data Engineering

Director, Data Engineering
Location: Remote (US)

About Us:

Headquartered in beautiful Santa Barbara, HG Insights is the global leader in technology intelligence. HG Insights uses advanced data science methodologies to help the world’s largest technology firms and the fastest-growing companies accelerate their sales, marketing, and strategy efforts. We offer a competitive salary, 401K, growth potential, stock options, great benefits, and a casual yet professional environment. We are passionate about our jobs with a get-it-done attitude, yet we don’t take ourselves too seriously.

What You’ll Do:

As the Director of Data Engineering, you will lead a high-performing team responsible for designing, building, and managing the data infrastructure and pipelines that drive HG Insights’ data products and services. You will define the strategic direction of the Data Engineering function, collaborate with cross-functional teams, and ensure the scalability, efficiency, and reliability of our data systems. Your role will be pivotal in ensuring the success of our data-driven initiatives.

What You’ll Be Responsible For:

Strategic Leadership

• Define and execute the strategic roadmap for the Data Engineering team.
• Align the data infrastructure and processes with the company’s business objectives and growth strategy.

Team Leadership and Development

• Lead, mentor, and grow a team of skilled data engineers, fostering a culture of collaboration, innovation, and excellence.
• Attract and retain top talent to build a world-class Data Engineering organization.

Data Infrastructure Management

• Oversee the development and optimization of scalable, reliable, and efficient data pipelines and platforms.
• Ensure data systems are designed for high availability, security, and performance.

Collaboration and Stakeholder Management

• Partner with Product, Data Science, Engineering, and Business teams to understand their data needs and deliver solutions that meet those needs.
• Act as a key liaison between technical teams and business stakeholders, ensuring alignment and transparency.

Innovation and Continuous Improvement

• Stay abreast of emerging technologies and industry best practices in data engineering.
• Drive the adoption of new tools, technologies, and methodologies to enhance the team’s efficiency and effectiveness.

Operational Excellence

• Define and enforce standards, processes, and best practices for data engineering.
• Monitor and optimize the performance of data systems to ensure they meet SLAs and business requirements.

1. Data Governance and Compliance

• Ensure that all data systems and processes comply with relevant regulations and standards.
• Implement robust data governance practices to maintain data quality and integrity.

What You’ll Need:

• BS or MS in Computer Science, Data Engineering, or a related field.
• 10+ years of experience in data engineering, with at least 5 years in a leadership role.
• Proven track record of designing and managing large-scale, distributed data systems.
• Deep expertise in data engineering technologies such as Hadoop, Spark, Kafka, and cloud platforms (AWS, Azure, GCP).
• Strong knowledge of database systems (SQL and NoSQL) and ETL processes.
• Excellent leadership and communication skills, with the ability to influence across all levels of the organization.
• Experience with data governance, compliance, and best practices.
• A passion for building scalable, efficient, and innovative data systems.

Why Join Us:

• Be part of a dynamic and innovative team driving growth in the tech industry.
• Opportunity to lead impactful projects and shape the future of data engineering at HG Insights.
• Competitive salary and benefits package.
• Collaborative and inclusive work environment.

Apply Today to lead the next phase of innovation in data engineering!