What You Will Do

As a Data Engineer, you will have the opportunity to expand your skills in a variety of areas while working on a data-focused team. On this team, you will be help architect and deliver a wide variety of code artifacts. You will be working to build a scalable and secure ETL solutions for operational, reporting and analytical data needs. In addition, you'll gain experience in CI/CD by utilizing Jenkins, Terraform, and Ansible. Our group has a focus on full cycle engineering - requirements to production support - this means you will have an opportunity to work on a variety of problems to solve while gaining Big Data experience. Although this is a specialized role you will have the freedom to expand your responsibilities and try new things you may be interested in.

You will be challenged to:• Design, develop and maintain ETL platforms for various business use cases which are fault tolerant, highly distributed and robust.• Analyze large sets of structured and semi structured data for business analytics and ETL design.• Translate business needs and vision into roadmap, project deliverables and organization strategies.• Design and implement ETL solutions using leveraging cloud native platforms.• Collaborate with analytics and business teams to design data models that feed business intelligence tools, increasing data accessibility and encouraging data driven solutions.

Skills and Experience You Will Need

• Good experience on designing and developing data pipelines for data ingestion and transformation using Spark.• Distributed computing experience using Pyspark or Python • Good understanding of spark framework and spark architecture.• Experience working in Cloud based big data infrastructure.• Excellent in trouble shooting the performance and data skew issues.• Must have good understanding of spark run time metrics and tune applications based on metrics.• Deep knowledge in partitioning, bucketing concepts of data ingestion.• Good understanding of AWS services like Glue, Athena, S3, Lambda, Cloud formation.• Preferred working knowledge on the implementation of datalake ETL using AWS glue, Databricks etc.• Experience with data modelling techniques for cloud data stores and on prem databases like Teradata, Teradata Vantage (TDV)etc• Preferred working experience in ETL development in Teradata vantage and data migration from on prem to Teradata vantage.• Proficiency in SQL, relational and non-relational databases, query optimization and data modelling.• Experience with source code control systems like Gitlab.• Experience with large scale distributed relational and NoSQL database systems.

Technologies:

• Pyspark, Python, AWS services, Teradata Vantage, CI/CD technologies, Terraform, SQL

Who We Are

GalaxE is a professional IT services firm that specializes in platform-driven solutions and the use of automation to achieve enterprise business transformation and mission-critical change for some of the largest companies in the world. Using our proprietary solution set, GxFource®, we apply machine learning techniques and predictive analytics tools as part of a broad artificial intelligence strategy that provides effective impact and data-driven business transformation.

Since its founding, GalaxE has been dedicated to advancing the benefits of technology. As we continue that legacy and look to the future, a focus on business enablement through agile, cost-efficient, and effective integration of people, process, and technology anchors our success. We revolutionize change in the costs of doing business that transform companies and their ability to leap beyond the competition.

At GalaxE we value people and are committed to diversity and inclusion where our employees are made to feel comfortable and are encouraged to be authentic. We focus on cultivating both traditional IT and non-traditional, new collar, workers through our Outsource to America®, program.

We are always looking for passionate, entrepreneurial-minded innovators and disrupters; game-changers that take ownership of the work they produce and bring it each and every day. Working with like-minded team members you will get a chance to discover, develop, and use cutting-edge technologies to transform the way we deliver creative business solutions.

Sound like you? Join us and find out for yourself what it means for you, and your career, to be part of the GalaxE team. Let's build something, together. #WeAreGalaxE

Equal Opportunity Employer/Veterans/Disabled

Physical Requirements:

• Prolonged periods of remaining stationary at a desk and working on a computer
• Must be able to lift to 15 lbs., as needed
• Must be able to work on-site (corporate/client offices), as needed (not applicable for 100% remote roles)
• Occasionally required to bend, kneel, crouch, and reach overhead.
• Hand-eye coordination necessary to operate computers and various pieces of office equipment.
• Specific vision abilities required include close vision, the ability to tolerate fluorescent lighting, and the ability to adjust focus.

Employees must be able to perform the physical requirements of the position satisfactorily and, if requested, reasonable accommodations will be made to enable employees requiring accommodations to perform the essential functions of their jobs, absent undue hardship.

For more information, please visit https://www.galaxe.com/