Arity - Full-Stack Software Engineer Expert (Java/Kafka/Go)

At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers' evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection.
Job Description
As a Software Engineer, the candidate will be responsible for assisting with the design, architecture, implementation, performance tuning, monitoring and on-going support of Arity's streaming platforms running within AWS.
We're looking for candidates who bring in:
Experience building highly reliable, secure and optimized streaming and batch applications
Experience building data pipelines and capabilities to process data to and from disparate sources
An understanding of large-scale data processing and data streaming tools
Key Responsibilities

• Lead the effort in design and development of Arity's streaming data platform and data pipelines using distributed streams as a primary building block
• Compose the building blocks of data architecture to fit Arity's changing business needs by continuously improving speed, security and reliability
• Provide hands-on leadership for data security, support, monitoring, and alerting of the distributed streaming stacks
• Collaborate with Product Managers, Data Architects, Project Managers, Designers and other Engineers to develop full stack solutions for streaming data
• Work in Agile/Scrum environment, design, estimate, test, and develop user stories
• Build large scale multi-node, highly performant and highly available streaming pipelines that can rapidly evolve to handle new technologies, techniques, and automation approaches
• Perform high-level, day-to-day operational maintenance, support, and upgrades for the stream and batch data processing infrastructure
• Create key performance metrics, measuring the utilization, performance and overall health of the clusters and infrastructure

Technical Experience & Skills

• Prior experience working on distributed systems, streaming processing systems using technologies similar to Flink, Spark, Kafka, NiFi , Go or similar streaming library experience on AWS or GCP.
• 8 years' of hands-on experience with data, back-end, infrastructure, performance or API development
• 5 years' experience designing, building and deploying large-scale, distributed, high-volume systems with reasonably high throughput of data
• Ability to build and optimize real-time streaming, batch and end to end data processing systems
• Understanding of Linux, ETL, Message Queuing Systems and Software Development Processes
• Experience working with Java, Python or similar programming and scripting languages, and a good understanding of AWS services

Qualifications

• Minimum Bachelor's Degree from an accredited institution in Computer Science or a related discipline, or equivalent experience/combined education, with some relevant professional experience
• Experience with Java, python, Golang, or equivalent programming language, and knowledge on scripting languages like Python, Shell Scripting or equivalent scripting languages
• Passion for software development and ability to write source code, reuse existing components, and evaluate and integrated open source software into solutions
• Proven ability to lead multiple high priorities initiative with aggressive timelines leveraging an agile/scrum framework
• Comfortable performing in a fast paced, dynamic and ambiguous business environment
• Excellent listening and communication skills and strong problem solving skills with the ability to design and implement technical solutions

#LI-MK1
Notes:
The preceding description is not designed to be a complete list of all duties and responsibilities. May be required to perform other related duties as assigned. Regular, predictable attendance is an essential function of this job.
The candidate(s) offered this position will be required to submit to a background investigation, which includes a drug screen.
Skills
Apache Flink, Apache Kafka, Apache NiFi, AWS Architecture, AWS Auto Scaling, AWS Identity And Access Management (IAM), AWS Tools, Go Programming Language, Java, Python (Programming Language)
Compensation
Compensation offered for this role is $112,000.00 - 196,750.00 annually and is based on experience and qualifications.
The candidate(s) offered this position will be required to submit to a background investigation, which includes a drug screen.
Joining our team isn't just a job - it's an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. And one where you can impact the future for the greater good.
You'll do all this in a flexible environment that embraces connection and belonging. And with the recognition of several inclusivity and diversity awards, we've proven that Allstate empowers everyone to lead, drive change and give back where they work and live.
Good Hands. Greater Together.®
Allstate generally does not sponsor individuals for employment-based visas for this position.
Effective July 1, 2014, under Indiana House Enrolled Act (HEA) 1242, it is against public policy of the State of Indiana and a discriminatory practice for an employer to discriminate against a prospective employee on the basis of status as a veteran by refusing to employ an applicant on the basis that they are a veteran of the armed forces of the United States, a member of the Indiana National Guard or a member of a reserve component.
For jobs in San Francisco, please click "here" for information regarding the San Francisco Fair Chance Ordinance.
For jobs in Los Angeles, please click "here" for information regarding the Los Angeles Fair Chance Initiative for Hiring Ordinance.
To view the "EEO is the Law" poster click "here". This poster provides information concerning the laws and procedures for filing complaints of violations of the laws with the Office of Federal Contract Compliance Programs
To view the FMLA poster, click "here". This poster summarizing the major provisions of the Family and Medical Leave Act (FMLA) and telling employees how to file a complaint.
It is the Company's policy to employ the best qualified individuals available for all jobs. Therefore, any discriminatory action taken on account of an employee's ancestry, age, color, disability, genetic information, gender, gender identity, gender expression, sexual and reproductive health decision, marital status, medical condition, military or veteran status, national origin, race (include traits historically associated with race, including, but not limited to, hair texture and protective hairstyles), religion (including religious dress), sex, or sexual orientation that adversely affects an employee's terms or conditions of employment is prohibited. This policy applies to all aspects of the employment relationship, including, but not limited to, hiring, training, salary administration, promotion, job assignment, benefits, discipline, and separation of employment.