Data Engineer

Company Description

Join a multibillion-dollar global company that brings together amazing technology, people, and operational scale to become a powerhouse in the memory industry. Headquartered in Rancho Cordova, California, Solidigm combines elements of an established, successful technology company with the spirit, agility, and entrepreneurial mindset of a start-up. In addition to the U.S. headquarters and other facilities in the U.S., the company has international presence in Asia, Europe, and the Americas. Solidigm will continue to lead the world in innovating new Memory technologies with aspirations to be the #1 NAND memory company in the world. At Solidigm, we view problems as opportunities to define innovative solutions that hold the power to change the world and unleash the potential technological needs that the future holds. At Solidigm, we are One Team that fosters a diverse, equitable, and inclusive culture that embraces individual uniqueness and empowers us to bring our best selves to deliver excellence in support of Solidigm's vision and mission to be the go-to partner for optimized data storage solutions. You can be part of the takeoff of an innovative business that develops cutting-edge products, delivers strong business value for customers, provides an engaging workplace for its employees, and serves a greater impact on the world. This is a golden opportunity for the right applicant to join us and help design, build, and lead Solidigm. We want a diverse team of dedicated professionals who will not just be Solidigm team members but contribute to how we shape the future of the organization. We are seeking applicants who will grow and thrive in our culture; be customer inspired, trusting, innovative, team-oriented, inclusive, results driven, collaborative, passionate, and flexible.

Job Description

We are seeking a skilled and motivated Data Engineer to join our global and innovative team of data professionals. The ideal candidate will have extensive experience with SQL Databases, ETL processes, Python programming, Kubernetes, GitHub, and system monitoring. This role involves modernizing, designing, developing, and maintaining our backend manufacturing data architecture. You will work closely with various teams to understand data requirements and deliver solutions that drive business insights and efficiencies.

Key Responsibilities:

• Programming:
  • Write clean, efficient, and maintainable code for data manipulation and automation tasks.
  • Ability to read, debug, support and improve code written by other developers.
  • Develop and implement data processing scripts and workflows.
  • Use GitHub for version control, code reviews, CI/CD, and collaboration with team members.
• Kubernetes:
  • Deploy and manage containerized applications using Kubernetes.
  • Ensure the scalability, reliability, and performance of data infrastructure on Kubernetes.
• Databases:
  • Manage and optimize databases in SingleStore, Microsoft SQL, and MySQL environments.
  • Ensure data integrity, security, and performance across database systems.
• ETL Processes:
  • Design, develop, and maintain ETL pipelines to ensure seamless data flow across various sources and destinations.
  • Optimize ETL processes for performance, scalability, and reliability.
• Monitoring and Logging:
  • Implement and configure monitoring solutions to track system performance, data pipelines, and applications.
  • Set up alerts and dashboards to proactively address issues and ensure system health and best practices.

Qualifications

Required Qualifications:

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer or in a similar role.
• Experience with SingleStore, Microsoft SQL, and MySQL databases.
• Strong proficiency in ETL tools and processes.
• Expertise in Python and C# programming languages.
• Experience with Azure and cloud services.
• Proficiency with container orchestration using Kubernetes.
• Familiarity with version control systems and CI/CD, particularly GitHub and GitHub Actions.
• Knowledge of monitoring tools like Datadog or Grafana.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Preferred Qualifications:

• Familiarity with data virtualization
• Proficiency with project tracking tools, preferably Jira.
• Excellent problem-solving skills and attention to detail.
• Active listening skills, including investigating requirements and proactively identifying potential issues.
• Critical thinker who naturally see opportunities to develop and optimize work processes - finding ways to simplify, standardize and automate.
• Self-directed imitator. People who take ownership of their work and need no prompting to drive productivity, change, and outcomes.
• Collaborative partner. Someone who build and leverage cross-functional relationships to bring together ideas, data, and insights to drive continuous improvement in execution.
• Analytical problem solvers. People who go beyond just fixing to identify root causes, evaluate optimal solutions, and recommend comprehensive upgrades to prevent future issues.
• Dedicated achiever. Someone who thrive in a fast-paced environment and will stop at nothing to ensure a project is completed and meets regulations.
• Ability to manage multiple tasks and prioritize effectively.
• Strong communication and teamwork abilities.

Provide expertise on database management/design to drive integration of business data, functions, and systems. Establish standards, guidelines, procedures, and other infrastructure necessary to support the objective of integration of data. Resolve performance problems. Plans and schedules daily tasks, uses judgement on a variety of problems requiring deviation from standard practices. Inadequacies and erroneous decisions would cause moderate inconvenience and expense.