The Role
Design and operate crash-safe binary data formats, relational schemas via async ORMs, HPC batch/interactive job lifecycle, async streaming APIs with backpressure and RBAC, and integrate backend calls to external AI/LLM services.
Summary Generated by Built In
Functional Focus: Data Engineering, Real-Time Streaming, and HPC Job Orchestration
- Scientific Data Architecture: Design crash-safe, binary data formats capable of handling high-speed incremental writes from compute jobs and concurrent reads for query-time calculations.
- Operational Data Modeling: Design and maintain a relational database schema via an async ORM, backend-agnostic across database engines.
- HPC Workload Management: Manage the lifecycle of batch and interactivecompute jobs, handling subprocess monitoring, status polling, and cluster filesystem coherency.
- Real-Time API & Streaming: Build async backend services and long-lived, server-pushed event channels with backpressure handling, and enforce role-based access control on all APIs.
- AI Service Integration: Integrate and orchestrate calls to an AI/analytics service from the backend, coordinating with application state.
Requirements
Mandatory:
- Python 3, async/await
- FastAPI (or similar async Python web framework)
- Relational DB modeling, async ORM (e.g. Tortoise, SQLAlchemy), SQL
- Server-Sent Events or WebSockets, backpressure handling
- Role-based access control (RBAC), token-based auth (JWT/OAuth)
- Subprocess management, batch job lifecycle/status polling
- Binary/streaming file format design, crash-safe writes
- REST/SDK integration with an external AI/LLM service
Optional:
- Go or another async-capable backend language
- GraphQL
- PostgreSQL administration, Alembic/migrations tooling
- Message queues/brokers (Redis, RabbitMQ, Kafka)
- Air-gapped/offline deployment experience
- HPC schedulers (SLURM, PBS), Linux cluster filesystems
- NumPy/columnar formats (Parquet, HDF5)
- Tool-calling / function-calling orchestration patterns
Benefits
We offer great career growth, ESOPs, Gratuity, PF and Health Insurance.
Skills Required
- Python 3, async/await
- FastAPI or similar async Python web framework
- Relational DB modeling and SQL
- Async ORM (e.g., Tortoise, SQLAlchemy)
- Server-Sent Events or WebSockets with backpressure handling
- Role-based access control (RBAC) and token-based auth (JWT/OAuth)
- Subprocess management and batch job lifecycle/status polling
- Binary/streaming file format design with crash-safe writes
- REST/SDK integration with an external AI/LLM service
- Go or another async-capable backend language
- GraphQL
- PostgreSQL administration and Alembic/migrations tooling
- Message queues/brokers (Redis, RabbitMQ, Kafka)
- Air-gapped/offline deployment experience
- HPC schedulers (SLURM, PBS) and Linux cluster filesystems
- NumPy and columnar formats (Parquet, HDF5)
- Tool-calling / function-calling orchestration patterns
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Astrome is a deeptech startup that is accelerating the deployment of 5G and rural telecommunication infrastructure through its patented millimeter wave E-band radios and satellite communication products
