- Data Integration and ETL Processes:Design, construct, install, and maintain large-scale processing systems and other infrastructure.
- Set up intricate ETL (Extract, Transform, Load) processes and workflows.
- Database Management:Manage and optimize databases to handle and query data effectively.
- Work closely with data architects to implement data models and schemas.
- Data Quality and Governance:Ensure systems meet business requirements and industry best practices.
- Monitor data quality, develop tools for automated validation, and ensure data privacy and compliance.
- Infrastructure and Performance Optimization:Optimize and fine-tune data queries and pipelines for improved performance and scalability.
- Collaborate with IT teams to ensure hardware and software infrastructure is up-to-date and optimal.
- Collaboration with Stakeholders:Work closely with data scientists, analysts, and other stakeholders to ensure data availability and accessibility for various analytics and machine learning projects.
- Create, maintain and optimise data-lakes and data warehouses
- Collaboration with BI team:Work closely and support the BI team with their needs for data availability and analytical reports
- Maintain BI tools:Oversee and maintain all engineering and technical aspects of the BI tools
- Documentation:Document all processes, architectures, and standards for better team alignment and compliance.
- Degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer, Software Developer, or similar role.
- Proficiency with big data tools like Hadoop, Spark, Kafka, etc.
- Familiarity with relational and NoSQL databases like PostgreSQL, MongoDB, etc.
- Expertise in ETL tools, cloud platforms (AWS, Azure, Google Cloud), and data warehousing solutions.
- Strong problem-solving skills and an analytical mind.
- A commitment to collaborative problem solving, sophisticated design, and producing quality products.
Top Skills
What We Do
Softup Technologies is an software development company based in Munich, Germany and in Tirana, Albania. The firm provides software development services for startups as well as SMEs that are looking to build or scale their teams. In less than two years, we have proudly served more than 15 clients, with their innovative projects in different industries. We stand for the highest quality and dedication, without breaking your bank. Within the next decade we will focus on the following: 1. Provide services with the most advanced technology and stack 2. Offer value added services to cover our client needs 3. Create some of the most innovative products 4. Build teams of startups and SMEs. Softup covers software development services known as "Full-Stack", which means: Front-End development: the presentation layer of an application. Back-End development: where the data is saved and where the algorithms guiding the data are managed. Value Added Services: UX/UI, design, QA, Infrastructure setup etc.
