The Role
As a Sr. Data Engineer, you'll design and build data systems for analysis and machine learning, focusing on data ingestion, pipelines, and visualization. You'll work with cloud-based solutions, optimize data storage, and perform transformations using ETL/ELT processes.
Summary Generated by Built In
As a Sr. Data Engineer, you’ll design, build, optimize and operate systems on cloud to collect, store, process, package and visualize data to extract insights and make it useable for advanced analytics and machine learning. You’ll design data pipelines for batch and streaming data, use big data tools and techniques for processing large amounts of data, and create purpose-built solutions for working with structured, semi-structured, and unstructured data to support analytics and machine learning workloads.
- Identify data sources, data formats, and design for data ingestion using batch and real-time techniques
- Design and build secure, scalable data repositories to store the data, optimizing for cost, compression, scalability, and integration with data processing tools
- Architect pipelines for data processing and transformation using ETL/ELT, SQL, Apache Spark, and other tools to handle high volume and high-velocity data
- Design server-less systems for ad-hoc data analysis
- Use visualization tools on processed data to create meaningful charts, and dashboards based on user-defined metrics
Requirements
- Python programming.
- Concepts of big data.
- Hadoop SQL and relational databases.
- Data warehousing concepts
- Experience Minimum 2 years of experience with AWS in development or operations role
- AWS Solutions Architect Associate certification is mandatory AWS Data Analytics Specialty certification is preferred
Benefits
We do not unfairly discriminate on any ground, including race, caste, religion, color, ancestry, marital status, gender, sexual orientation, age, nationality, ethnic origin, disability or any other category protected by applicable law.
Competitive Salary
Better Growth
Work Life Balance
Skills Required
- Python programming
- Concepts of big data
- Hadoop SQL and relational databases
- Data warehousing concepts
- Minimum 2 years of experience with AWS in development or operations role
- AWS Solutions Architect Associate certification
- AWS Data Analytics Specialty certification
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Minfy Technologies is a provider of IT service suite solutions, specializing in AI cloud solutions, digital transformation, strategic advisory, modern application development, and cloud infrastructure. They act as an Applied Technology Architect and Cloud Native System Integrator, guiding businesses through digital journeys leveraging cloud and AI.
