Key Responisiobilities
Understanding the business requirements
Writing code and implementing the proposed solutions
Creating data pipelines, versioning and change management
Manage the complexity inherent in versioned data pipelines
Develop ETL/ELT processes to help extract and manipulate data from multiple sources.
Design, build and maintain batch or real-time data pipelines in production.
Automate data workflows such as data ingestion, aggregation, and ETL processing.
Logging and instrumentation of pipelines and services.
Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
Train and mentor junior engineers.
Minimum Qualifications
Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role
Advanced SQL skills and experience with relational databases and database design.
Experience working with cloud Data Warehouse solutions (e.g., Snowflake, Redshift, BigQuery, Azure Synapse, etc.).
Strong Python skills with hands-on experience on Pandas, NumPy and other data related libraries
Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive etc
Proficiencient in data pipeline and workflow management tools e.g. Airflow
Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight etc
Experience with the AWS/Azure/GCP data engineering services
Knowledge of AWS services viz., S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM
OR
Knowledge of Azure services viz., ADF, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB
Very good exposure of working on Data Lakes & Data Warehouses solutions
Excellent problem-solving, communication, and organizational skills.
Proven ability to work independently and with a team.
Ability to guide other data engineers.
Additional Experience
Experience working with data ingestion tools such as Fivetran, stitch, or Matillion.
Good understanding of NoSQL databases like Redis, Cassandra, MongoDB, or Neo4j.
Familiarity with machine learning technologies.
Experience in Java or Scala
- Flexibility & Well-being – Our remote-first approach gives you the flexibility to work where you perform best, while prioritizing your well-being and personal commitments.
- Global Community – Collaborate with talented colleagues across the globe in a culture built on connection, support, and shared success.
- Your Voice Matters – We foster open communication and multiple feedback channels, ensuring every employee has the opportunity to be heard and make an impact.
- Growth & Development – Gain exposure to diverse clients, industries, and challenges that accelerate learning and career growth.
Our culture is guided by four core values: Collaboration, Outperform, Respect, and Evolve—the principles that shape how we work, grow, and succeed together.
Skills Required
- 5+ years experience as a data engineer or similar role
- Advanced SQL skills and relational database design
- Experience with cloud data warehouse solutions (Snowflake, Redshift, BigQuery, Azure Synapse)
- Strong Python skills with hands-on experience using Pandas and NumPy
- Experience with big data technologies (Spark, MapReduce, Hadoop, Hive)
- Proficient in data pipeline and workflow management tools (e.g., Airflow)
- Experience with data visualization tools (PowerBI, Tableau, AWS QuickSight)
- Experience with cloud data engineering services on AWS, Azure, or GCP
- Knowledge of AWS services (S3, Lambda, EMR, Glue ETL, Athena, RDS, Redshift, EC2, IAM)
- Knowledge of Azure services (ADF, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB)
- Strong exposure to Data Lakes and Data Warehouses solutions
- Excellent problem-solving, communication, and organizational skills
- Proven ability to work independently and collaboratively on teams
- Ability to guide and mentor other data engineers
- Experience with data ingestion tools such as Fivetran, Stitch, or Matillion
- Understanding of NoSQL databases (Redis, Cassandra, MongoDB, Neo4j)
- Familiarity with machine learning technologies
- Experience in Java or Scala
What We Do
3Pillar Global builds breakthrough software products that power digital businesses. 3Pillar is an innovative product development partner whose solutions drive rapid revenue, market share, and customer growth for industry leaders in Software and SaaS, Media and Publishing, Information Services, and Retail. Leveraging a lean and agile approach, 3Pillar delivers value-generating, digital solutions with specialized product strategy and management, user experience design, as well as software and data engineering expertise across mobile, cloud, and disruptive technologies.
