Responsibilities:
- Design, develop, and maintain scalable data pipelines to support ingestion, transformation, and delivery into centralized feature stores, model-training workflows, and real-time inference services.
- Build and optimize workflows for extracting, storing, and retrieving semantic representations of unstructured data to enable advanced search and retrieval patterns.
- Architect and implement lightweight analytics and dashboarding solutions that deliver natural language query experience and AI-backed insights.
- Define and execute processes for managing prompt engineering techniques, orchestration flows, and model fine-tuning routines to power conversational interfaces.
- Oversee vector data stores and develop efficient indexing methodologies to support retrieval-augmented generation (RAG) workflows.
- Partner with data stakeholders to gather requirements for language-model initiatives and translate into scalable solutions.
- Create and maintain comprehensive documentation for all data processes, workflows and model deployment routines.
- Should be willing to stay informed and learn emerging methodologies in data engineering, MLOps and LLM operations.
Requirements:
- 8+ years of experience as a Data Engineer.
Demonstrated experience in utilizing Python for data engineering tasks, including transformation, advanced data manipulation, and large-scale data processing.
Hands-on experience with big data technologies including Apache Spark, Hadoop, and Kafka for distributed processing and real-time data ingestion.
Experience designing complex data pipelines extracting data from RDBMS, JSON, API, and Flat file sources.
Demonstrated skills in SQL and PLSQL programming, with advanced mastery in Business Intelligence and data warehouse methodologies, along with hands-on experience in one or more relational database systems and cloud-based database services such as Snowflake/Redshift
Understanding of software engineering principles and skills working on Unix/Linux/Windows Operating systems, and experience with Agile methodologies.
Proficiency in version control systems, with experience in managing code repositories, branching, merging, and collaborating within a distributed development environment.
- Interest in business operations and comprehensive understanding of how robust BI systems drive corporate profitability by enabling data-driven decision-making and strategic insights.
Effective oral and written English communication skills with BI team and user community.
Pluses
- Experience with vector databases such as DataStax AstraDB, and developing LLM-powered applications using popular open source frameworks like LangChain and LlamaIndex–including prompt engineering, retrieval-augmented generation (RAG), and orchestration of intelligent workflows.
- Familiarity with evaluating and integrating open-source LLM frameworks–such as Hugging Face Transformers/LLaMA-4 across end-to-end workflows, including fine-tuning and inference optimization.
- Knowledge of MLOps tooling and CI/CD pipelines to manage model versioning and automated deployments.
What we offer:
- Remote work opportunity!
- B2B Employment ($, gross).
- Stable job with long-term growth perspective with talented people around.
- Really good hardware.
- Great learning and growth opportunities.
- Compensation for professional training, seminars, and conferences.
- Referral program – get rewarded for helping us grow the team with talented people.
- Company-supported English classes to enhance your professional growth.
IDT Corporation is a global communications company founded in 1990 and headquartered in Newark, New Jersey. We are industry leaders in prepaid communication and payment services and one of the largest international voice carriers. We are listed on the NYSE, employ over 1800 people across 20 countries, and have over $1.5 billion in revenues.
IDT is not ”another big IT corporation”— we encourage and support in-house entrepreneurs in developing their ideas into business actions.
Our flagship brand, BOSS Revolution, offers Money Transfer, International Calling, and Mobile Top-Up services and supports IDT’s mission of enabling people to keep in touch and share resources with family and friends worldwide.
Skills Required
- 8+ years of experience as a Data Engineer
- Advanced Python experience for data transformation, manipulation, and large-scale data processing
- Hands-on experience with Apache Spark, Hadoop, and Kafka
- Experience designing data pipelines using RDBMS, JSON, APIs, and flat files
- Advanced SQL and PL/SQL programming skills
- Business intelligence and data warehouse expertise
- Experience with relational databases and cloud databases such as Snowflake or Redshift
- Understanding of software engineering principles
- Experience with Unix, Linux, or Windows operating systems
- Experience with Agile methodologies
- Proficiency with version control, repositories, branching, merging, and distributed collaboration
- Interest in business operations and understanding of BI-driven decision-making
- Effective oral and written English communication skills
- Experience with vector databases such as DataStax AstraDB
- Experience developing LLM-powered applications with LangChain or LlamaIndex
- Experience with prompt engineering, RAG, and intelligent workflow orchestration
- Familiarity with Hugging Face Transformers or LLaMA-4
- Experience with LLM fine-tuning and inference optimization
- Knowledge of MLOps tooling and CI/CD pipelines for model versioning and automated deployments
IDT Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about IDT and has not been reviewed or approved by IDT.
-
Healthcare Strength — Medical, dental, and vision coverage are included for full‑time employees, with published transparency files indicating employer‑sponsored health plans. This establishes a conventional benefits foundation across major coverage areas.
-
Leave & Time Off Breadth — Paid vacation and sick time are characterized as generous, with illustrations of multi‑week vacation and defined sick‑leave allotments that can vary by team and tenure. This breadth provides a solid baseline for time away from work.
-
Wellbeing & Lifestyle Benefits — Office amenities such as an on‑site gym, recreation spaces, free breakfast and coffee, and flexible work arrangements are highlighted. These wellbeing‑oriented perks augment the core package for in‑office and hybrid roles.
IDT Insights
What We Do
We know that you’ll have looked at quite a few company pages but IDT is different. We want people who want to make a big difference to our company with big ambitions. We’re a truly global team, with 1300 people working across all continents, apart from (at the moment!) Antarctica. But we are proud that despite our size, we encourage and support any in-house entrepreneurs to develop their ideas into business action. Our exciting growth plans make it a great time to join us. Our people are the reason for IDT’s passion for success. The IDT family is made up of people of all backgrounds, expertise, and interests, all with a relentless team spirit. We need people who share both our commitment to success and excitement about our journey. You won’t ever be bored or have to wonder how to fill your time. You’ll find the work challenging but you’ll get the support of a great team to help you beat those challenges. You will also be expected to support others as well as work hard, work well and work with a smile. If you want a join a company that will help you become your brilliant best and achieve amazing results, then you want to join IDT.
