We are hiring a Senior Engineer, who will support a critical digital transformation project for one of EPAM's top clients. This is a high-impact role, with the opportunity to advance your skills and grow within a global organization.
We live and breathe big data. Daily, we ingest and extract useful information from hundreds of live TV channels as well as collect, analyze, and report on information from millions of active TVs. We're all in with AWS and make extensive use of many of their services. On any given day we are running between 4500-5000 instances with 100+ internal services on a stack and application set that includes Ubuntu, C, Python, RDS, Kafka, Elastic, Redshift and Kinesis, Databricks.
As any organization that has grown organically and significantly over time there is a lot to manage and a fair amount of tech debt. This means you will have the opportunity to come in and manage what we have while helping reimagine how we approach specific operational challenges such as administration, monitoring, logging, configuration management and automation.
If you'd like to learn more about this position and project, apply now! Connect with a recruiter today!
Req.#514966428
RESPONSIBILITIES

• Independently design, build and launch new data extraction, transformation and loading processes in production
• Identify the data needed for a business problem and implement the logging required to ensure the availability of data, while working with data infrastructure to triage issues and resolve them
• Build data expertise and leverage data controls to ensure privacy, security, compliance, data quality, and operations for allocated areas of ownership
• Design, build and launch new data models
• Support existing processes running in production and implement optimized solutions with limited guidance
• Work with terabyte-to-petabyte scale data

REQUIREMENTS

• Minimum of 5 Years of relevant experience
• Previous experience as a data engineer or in a similar role
• Technical expertise with data models, data mining, and segmentation techniques
• Good experience in Python, SQL, AWS is required
• Experience with Big Data platforms such as Databricks is a must
• Experience with Map-Reduce and/or spark computing frameworks
• Experience in working with different Cloud Environment/s (AWS is highly preferred)
• Hands-on experience with SQL database design, ETL Tools/scripts
• Great numerical and analytical skills
• Excellent written and verbal communication skills; proactive communication to your team, management, and business stakeholders
• Degree in Computer Science, IT, or similar field; a Master's is a plus

BENEFITS

• Medical, Dental and Vision Insurance (Subsidized)
• Health Savings Account
• Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)
• Short-Term and Long-Term Disability (Company Provided)
• Life and AD&D Insurance (Company Provided)
• Employee Assistance Program
• Unlimited access to LinkedIn learning solutions
• Matched 401(k) Retirement Savings Plan
• Paid Time Off
• Legal Plan and Identity Theft Protection
• Accident Insurance
• Employee Discounts
• Pet Insurance
• Employee Stock Purchase Program

ABOUT EPAM

• EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential