We're seeking an experienced Data Engineer to design, develop, and maintain robust data pipelines and infrastructure for Acelab – B2B marketplace that connects architects and designers with building material manufacturers. This role will be crucial in managing our data ecosystem, implementing advanced analytics, and supporting our data science and engineering teams in delivering high-quality insights and products.

Key Responsibilities:

Design, develop, and maintain pipelines for importing and cleaning semi-structured data from various sources
Specify, deploy, and manage scalable and reliable data pipeline infrastructure
Design and implement database schemas to efficiently store and retrieve complex and sparse data
Collaborate closely with data science and engineering teams to reconcile datasets and ensure data consistency across systems
Develop and maintain data quality checks and monitoring systems
Optimize data storage and retrieval processes for improved performance and cost-effectiveness
Participate in code reviews and contribute to best practices for data engineering
Stay up-to-date with the latest trends and technologies in data engineering and big data processing

Requirements

Ideal fit would be someone with experience in data-intensive industries such as e-commerce (e.g., Wayfair, Amazon, Shopify) or similar high-volume data environments
Bachelor's or Master's degree in Computer Science, Data Science, or a related field
3+ years of experience in data engineering or a similar role
Strong proficiency in SQL, and at least one big data processing framework (e.g., Apache Spark, Hadoop)
Some experience with .NET Web API
Experience with cloud platforms (AWS, Azure, or GCP) and their data services
Solid understanding of data modeling, ETL processes, and data warehousing concepts
Familiarity with version control systems (e.g., Git) and CI/CD practices
Knowledge of data governance and security best practices
Strong problem-solving skills and attention to detail
Excellent communication skills and ability to work in a collaborative environment
Experience with Agile development methodologies

Benefits

Work with some of the brightest minds in AEC, including former CEO of Revit
Unlimited PTO, Sick Days, Paid National Holidays, and more
Medical, dental, vision, short-term/long-term disability plans, and 401(k)
Opportunities for growth, creativity, and ownership
Flexible and remote work schedules

Acelab

Latest Jobs

Data Engineer