Location: Houston, TX (Hybrid)
Key Responsibilities:
- Design, develop, and optimize data pipelines and transformations using PySpark and Databricks.
- Collaborate with data architects and analysts to define and implement scalable data models and frameworks.
- Build and maintain complex data ingestion and processing workflows for large, distributed datasets.
- Develop reusable and efficient code following best practices in coding, testing, and deployment.
- Optimize Spark jobs for performance, scalability, and reliability in production environments.
- Work closely with cross-functional teams to ensure data quality, consistency, and integrity.
- Contribute to continuous improvement of the data engineering ecosystem and CI/CD processes.
- 5+ years of experience in software development with a focus on Python and PySpark.
- Hands-on expertise in Databricks platform — including cluster management, notebooks, and job orchestration.
- Strong programming fundamentals (data structures, algorithms, debugging, version control).
- Experience with Delta Lake, Spark SQL, and data lake architectures.
- Solid understanding of distributed computing, data partitioning, and Spark performance tuning.
- Familiarity with cloud platforms such as Azure, AWS, or GCP.
- Excellent communication and problem-solving skills — able to explain complex technical concepts clearly.
Similar Jobs
What We Do
CrackaJack Digital Solutions is an IT company in business since 2016 with offices in Portland, Oregon and Pune, India.
We primarily serve small to mid-sized businesses across the United States to unleash the power of digital transformation. We specialize in several areas of technology with a particular focus on managed IT services, remote infrastructure, recruiting & staffing technical talent, and website development & maintenance.
We pride ourselves on providing practical and effective technology solutions ranging in scope and size.
Our MISSION
Inspire and transform businesses through digital innovations to accelerate long-term sustainable revenue growth.
Our VISION
The Pacific Northwest’s most successful and impactful digital IT transformation service provider.
Our PURPOSE
Listen & seek to understand
Lead with data & insights
Leverage expertise
