Job Description:

We’re seeking a talented and experienced Data Engineer to join our team. In this role, you’ll be the go-to person for managing and optimizing our data infrastructure, ensuring our data pipelines are efficient, scalable, and secure. You’ll play a pivotal role in enabling data-driven decisions across the organization by leveraging AWS Data Lake solutions, making quality data highly accessible for analytics, machine learning, and business insights.

You’ll work closely with cross-functional teams to design, build, and maintain robust data pipelines that meet our business's evolving needs. Your expertise will help ensure that we handle data efficiently and securely while also focusing on cost-effectiveness.

Key Responsibilities:

Enhanced Data Management :
- Streamline the flow of data through our systems to ensure it’s always available when needed for analysis and decision-making.
- Take charge of building and optimizing ETL processes to ensure high data quality and integrity.
- Data Quality Assurance: Establish best practices for ensuring data quality, including implementing validation checks, anomaly detection, and continuous auditing of data pipelines.
- Collaboration for Data Architecture: Work closely with the software engineering team to ensure data pipelines align with overall system architecture and business processes.
- Documentation and Knowledge Sharing: Maintain clear and detailed documentation for all data pipelines, ensuring easy hand-off and team collaboration. Provide training and support to other teams on best data practices.
Scalability and Performance :
- Design and develop scalable data pipelines that can handle increasing volumes of data while optimizing storage and retrieval for speed and cost.
- Work with AWS Data Lake solutions to ensure our data infrastructure can grow alongside our business.
Security and Compliance :
- Implement strong data security measures to protect sensitive information and ensure compliance with industry regulations.
- Regularly monitor and maintain our data infrastructure to mitigate risks and develop and uphold our data governance standards.
Support for Advanced Analytics :
- Partner with data scientists and analysts to provide them with clean, well-structured data, supporting advanced analytics and machine learning projects.
- Integrate data from multiple sources to enable innovative analytics and business insights.
Cost Efficiency :
- Leverage AWS-managed services to reduce operational overhead and optimize storage costs as appropriate.
- Continuously look for cost-effective ways to maintain system performance and improve resource utilization.

Required Experience/Skills:

Bachelor's degree in computer science, data engineering, or a related field (Advanced degree preferred).
5+ years of hands-on experience designing and maintaining data pipelines using AWS services, especially AWS Data Lake.
Proficiency in ETL tools and processes and integrating data from various sources.
Expertise in data security
Strong skills in SQL and Python, with experience using AWS
Problem-solving skills and the ability to think critically about how to optimize processes.
Excellent communication skills – working with teams across the organization.
Local candidates strongly preferred

Preferred Skills:

Experience with big data technologies.

Knowledge of data governance best practices is highly beneficial.

Experience in energy or another data-heavy industry is a plus.

Familiarity with cloud cost management and optimization strategies.

Experience with machine learning operations (MLOps) and building pipelines that support ML model development and deployment

Company Highlights:

For 90 years, we have nurtured creative ideas and turned them into successful realities using three core strategic pillars – creativity, excellence, and people.
401K – 12% employer contribution with no vesting period (6% Match and 6% non-matching contribution)
Highly competitive compensation
Hybrid work options available for most roles
Five to eight weeks of PTO annually based on years of experience; eleven additional holidays per calendar year
All Medical/Dental/Vision benefits start day one with the company; low employee premiums
Education Assistance Program
Free covered employee parking for Dallas HQ based employees
Free specialty coffee bar in the Dallas HQ
Commitment to the following ideals:
- Work/Life Balance
- Ongoing professional development opportunities
- An exceptional employee experience

Hunt is committed to a diverse and inclusive workplace. Hunt is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.

#LI-HYBRID ; #LI-huntenergy

Hunt Consolidated, Inc.

Latest Jobs

Data Engineer