Role Overview
As a Software Engineer, you will be responsible for developing software frameworks, drivers, and tools that accelerate open-source big data processing frameworks on custom hardware accelerators. Your work will focus on enabling and optimizing large-scale data processing workloads in tailor-made cloud environments, ensuring seamless integration with AWS-based data processing services. You will develop and optimize software stacks, implement benchmarking, debugging, and performance analysis tools, and evaluate acceleration gains to enhance efficiency and performance in cloud-based data platforms.
Qualifications & Skills
Required Qualifications:
- Bachelor's degree in Computer Science, Electrical Engineering, or a related field from a leading university.
- Strong programming proficiency in C++ under Linux.
- 5+ years of experience in software development, focusing on high-performance computing.
Preferred Qualifications:
- Experience in runtime system development and low-level performance optimization.
- Strong background in debugging complex system environments.
- Experience implementing and optimizing multi-threaded algorithms.
- Solid understanding of columnar storage formats (e.g., Parquet) and their impact on query performance.
- Familiarity with AWS cloud services, including AWS EMR, S3, and EC2.
- Proficiency in Python or Scala for data processing and system development.
- Familiarity with hardware accelerators.
Top Skills
What We Do
DualBird exists to solve the $7 trillion data infrastructure crisis. By 2030, enterprises will need nearly that much in new data center investment just to keep pace with AI and analytics demand. Traditional approaches: adding more GPUs, optimizing runtimes, expanding infrastructure: only postpone the bottleneck. The math doesn't work. We've built a cloud-native engine that fuses hardware and software into a single solution: delivering 10-100x faster performance and 50-90% cost savings through a simple plug-in. No infrastructure overhaul. No manual tuning. Just hardware-grade acceleration with software simplicity. Our approach leverages rewritable hardware in the cloud to bring specialized acceleration to data workloads instantly. Processes that once took hours now finish in minutes. Workloads once too expensive to run frequently – like AI model retraining – become practical and affordable. Our impact is already proven: Customer pilots are showing transformational results across analytics and AI infrastructure. Enterprises are processing data at speeds and costs previously impossible with general-purpose CPUs. Backed by Lightspeed Venture Partners, Bessemer Venture Partners, Uncork Capital, and Angular Ventures, we're a team of veterans from Amazon AWS and the semiconductor industry, building the infrastructure that will power the next era of data. Learn more at www.dualbird.io
