Elastic Data Engineer

Diverto is one of the foremost providers of information cyber security services, dedicated to safeguarding businesses, institutions, and organizations of all sizes. Since our founding in 2007, we've been headquartered in Zagreb, Croatia, where our team works tirelessly to protect our clients from the ever-evolving landscape of security threats.  

Our mission is simple yet crucial: to shield our clients from the risks that can lead to the theft of confidential information, financial losses, and potential harm to their reputation. We understand that in today's digital world, security is paramount, and that's why we go above and beyond to deliver comprehensive solutions tailored to meet the unique needs of each client.  

Through our wide range of services, innovative products, and customized solutions, we empower our clients to achieve the highest levels of security. We’re not just a service provider—we’re a trusted partner committed to helping our clients navigate the complexities of information security with confidence and peace of mind. 

As an Elasticsearch Data Engineer, you will play a crucial role in managing, optimizing, and scaling our Elasticsearch clusters to ensure seamless data retrieval and search functionalities across our systems. You will work closely with cross-functional teams to design, implement, and maintain robust data pipelines and Security Information and Event Management (SIEM) solutions. In addition to your expertise in Elasticsearch, your knowledge of Linux systems and DevOps technologies will be vital in automating processes, managing infrastructure, and improving our overall data engineering practices. 

Key Responsibilities: 

• Architect and deploy Elasticsearch clusters for high availability, scalability, security, and performance.
• Fine-tune and optimize Elasticsearch indices and queries to enhance search speed and efficiency. 
• Monitor and maintain the health of Elasticsearch clusters, performing necessary troubleshooting and maintenance. 
• Develop and maintain data pipelines for ingesting, processing, and storing large datasets in Elasticsearch. 
• Work with ETL processes to ensure smooth data flow between various sources and Elasticsearch. 
• Manage and optimize Linux-based servers hosting Elasticsearch and other data services. 
• Automate routine tasks using shell scripting or other tools to enhance system reliability and efficiency. 
• Monitor system performance, identify potential issues, and implement proactive solutions. 
• Implement and maintain CI/CD pipelines to ensure efficient and automated deployment of data engineering solutions. 
• Work with DevOps tools like Docker, Ansible, or Terraform to automate infrastructure management. 
• Implement and manage security features within Elasticsearch, including role-based access control (RBAC), encryption, and audit logging. 
• Develop and enforce security best practices to protect sensitive data stored in Elasticsearch clusters. 
• Stay current with the latest security updates and patches, ensuring that Elasticsearch clusters are protected against known vulnerabilities. 
• Design, deploy, and manage SIEM solutions using the Elastic Stack to monitor, detect, and respond to security incidents. 
• Integrate Elasticsearch with various data sources to collect and analyze security-related data, including logs from firewalls, intrusion detection systems, and endpoint protection tools. 
• Develop and fine-tune alerting mechanisms and dashboards within Kibana to provide real-time insights into security threats. 
• Document processes, configurations, and best practices related to Elasticsearch and data engineering workflows. 
• Stay up to date with the latest developments in Elasticsearch, Linux, and DevOps technologies, and introduce innovative solutions to improve existing systems. 

Desired Qualifications:

Experience: 

• Proven experience (3+ years) as a Data Engineer with a strong focus on Elasticsearch. 
• Hands-on experience managing and optimizing Elasticsearch clusters in a production environment. 
• Solid experience with Linux system administration, including performance tuning and troubleshooting. 
• Strong background in DevOps methodologies and tools, particularly in CI/CD, containerization, and infrastructure as code. 

Technical Skills: 

• Proficiency in Elasticsearch, Logstash, beats, and Kibana (ELK Stack). 
• Good programming skills in languages such as Python, Java, or Bash scripting. 
• Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and their data services. 
• Knowledge of containerization tools like Docker and orchestration platforms like Kubernetes. 
• Familiarity with configuration management tools (e.g., Ansible, Puppet, Chef) and infrastructure as code (e.g., Terraform). 

Soft Skills: 

• Excellent problem-solving skills and attention to detail. 
• Strong communication and collaboration skills, with the ability to work effectively in a team environment. 
• Ability to manage multiple tasks and projects simultaneously, with a focus on delivering high-quality results. 
• Preferred Qualifications: 
• Certification in Elasticsearch or related technologies. 
• Experience with monitoring and logging tools like Prometheus, Grafana, or Elasticsearch's own monitoring tools. 
• Knowledge of data security best practices and compliance standards. 

Benefits: 

• Learning and sharing experiences with well-known and respected IT security experts.  
• Certification (Elastic, SANS/GIAC, OffSec, (ISC)², ISACA, CompTIA, EC-Council, Cisco, Security Blue Team, …) and internal education/workshops.  
• Challenging projects that involve current IT solutions. 
• Competitive salary and performance-based bonuses. 
• Additional and supplementary health insurance. 
• Multisport membership. 
• Flexible working hours and remote work options.