Job Summary
We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for designing and implementing data solutions, ensuring data accuracy, and developing ETL processes.
Responsibilities
- Proven experience in rolling out Elastic based SoC. Has a wide understanding of Elastic Engineering and architecture.
- Proficiency in Elasticsearch and its ecosystem (Kibana, Logstash, Beats).
- Strong understanding of data modeling, indexing strategies, and sharding.
- Experience with data ingestion, transformation, and loading (ETL) processes.
- Knowledge of data pipelines, batch processing, and real-time streaming.
- Familiarity with distributed computing for scalability.
- Programming or Scripting languages such as Python or Java (e.g Nifi)
- Distributed systems knowledge.
- Monitoring and performance tuning skills.
- Role Based Access Control / spaces
Performance Focused Skills
- Cluster sizing and capacity planning.
- Scaling strategies (vertical vs. horizontal scaling).
- Load balancing and resource optimization.
- Performance testing and benchmarking.
Job Type: Fixed term contract
Contract length: 12 months
Pay: £300.00-£380.00 per day
Benefits:
- Company pension
- Private medical insurance
- Work from home
Flexible language requirement:
Experience:
- Elastic based SoC: 3 years (required)
- Elasticsearch and its ecosystem (Kibana, Logstash, Beats): 3 years (required)
- Data modelling: 2 years (required)
- Data Ingestion, Transformation, and Loading (ETL): 2 years (required)
- Data Pipelines, Batch Processing: 2 years (required)
- Python or Java: 2 years (required)
Work Location: In person