Design, build, and maintain scalable data pipelines and architectures. Oversee AI-enhanced business intelligence and LLM initiatives while collaborating with stakeholders.
This is a full-time work from home opportunity for a star Data/ML Engineer from LATAM.
IDT(www.idt.net) is an American telecommunications company founded in 1990 and headquartered in New Jersey. Today it is an industry leader in prepaid communication and payment services and one of the world’s largest international voice carriers. We are listed on the NYSE, employ over 1300 people across 20+ countries, and have revenues in excess of $1.5 billion.
We are looking for a skilled Data/ML Engineer to join our BI team and take an active role in designing, building, and maintaining the end-to-end data pipeline, architecture and design that powers our warehouse, LLM-driven applications, and AI-based BI. If you're looking for a company that will give you the maximum flexibility in choosing a location to work, this opportunity is for you!
Responsibilities:
- Design, develop, and maintain scalable data pipelines to support ingestion, transformation, and delivery into centralized feature stores, model-training workflows, and real-time inference services.
- Build and optimize workflows for extracting, storing, and retrieving semantic representations of unstructured data to enable advanced search and retrieval patterns.
- Architect and implement lightweight analytics and dashboarding solutions that deliver natural language query experience and AI-backed insights.
- Define and execute processes for managing prompt engineering techniques, orchestration flows, and model fine-tuning routines to power conversational interfaces.
- Oversee vector data stores and develop efficient indexing methodologies to support retrieval-augmented generation (RAG) workflows.
- Partner with data stakeholders to gather requirements for language-model initiatives and translate into scalable solutions.
- Create and maintain comprehensive documentation for all data processes, workflows and model deployment routines.
- Should be willing to stay informed and learn emerging methodologies in data engineering, MLOps and LLM operations.
Requirements:
- 8+ years of experience as a Data Engineer with 2+ years focused on MLOps.
- Excellent English communication skills.
- Effective oral and written communication skills with BI team and user community.
- Demonstrated experience in utilizing python for data engineering tasks, including transformation, advanced data manipulation, and large-scale data processing.
- Deep understanding of vector databases and RAG architectures, and how they drive semantic retrieval workflows.
- Skilled at integrating open-source LLM frameworks into data engineering workflows for end-to-end model training, customization, and scalable inference.
- Experience with cloud platforms like AWS or Azure Machine Learning for managed LLM deployments.
- Hands-on experience with big data technologies including Apache Spark, Hadoop, and Kafka for distributed processing and real-time data ingestion.
- Experience designing complex data pipelines extracting data from RDBMS, JSON, API and Flat file sources.
- Demonstrated skills in SQL and PLSQL programming, with advanced mastery in Business Intelligence and data warehouse methodologies, along with hands-on experience in one or more relational database systems and cloud-based database services such as Snowflake/Redshift.
- Understanding of software engineering principles and skills working on Unix/Linux/Windows Operating systems, and experience with Agile methodologies.
- Proficiency in version control systems, with experience in managing code repositories, branching, merging, and collaborating within a distributed development environment.
- Interest in business operations and comprehensive understanding of how robust BI systems drive corporate profitability by enabling data-driven decision-making and strategic insights.
Pluses
- Experience with vector databases such as DataStax AstraDB, and developing LLM-powered applications using popular open source frameworks like LangChain and LlamaIndex–including prompt engineering, retrieval-augmented generation (RAG), and orchestration of intelligent workflows.
- Familiarity with evaluating and integrating open-source LLM frameworks–such as Hugging Face Transformers/LLaMA-4 across end-to-end workflows, including fine-tuning and inference optimization.
- Knowledge of MLOps tooling and CI/CD pipelines to manage model versioning and automated deployments.
Please attach CV in English.
The interview process will be conducted in English.
Only accepting applicants from LATAM.
Top Skills
Spark
AWS
Azure Machine Learning
Datastax Astradb
Hadoop
Hugging Face Transformers
Kafka
Langchain
Llamaindex
Plsql
Python
Redshift
Snowflake
SQL
Similar Jobs
Information Technology • Productivity • Software • Infrastructure as a Service (IaaS)
The role involves developing user interfaces using React, collaborating with designers and engineers, and improving code quality. It requires significant experience and a strong emphasis on accessibility and responsive design.
Top Skills:
AWSCSSFigmaJavaScriptReactStorybook
Artificial Intelligence • Hardware • Information Technology • Security • Software • Cybersecurity • Big Data Analytics
Responsible for designing, developing, and maintaining ETL/ELT pipelines using Databricks and Apache Spark, ensuring data quality and integrity across different sources.
Top Skills:
.Net CoreSparkC#Cosmos DbDatabricksDynamoDBMariadbMongoDBMySQLPowershellPythonSQL Server
Information Technology • Productivity • Software • Infrastructure as a Service (IaaS)
Senior Software Engineer will design and implement scalable solutions, develop software applications ensuring quality, and commit code for enterprise-level challenges.
Top Skills:
APIsAWSC++JavaJerseyKotlinPostgresRedisRestSpring
What you need to know about the Montreal Tech Scene
With roots dating back to 1642, Montreal is often recognized for its French-inspired architecture and cobblestone streets lined with traditional shops and cafés. But what truly sets the city apart is how it blends its rich tradition with a modern edge, reflected in its evolving skyline and fast-growing tech industry. According to economic promotion agency Montréal International, the city ranks among the top in North America to invest in artificial intelligence, making it le spot idéal for job seekers who want the best of both worlds.
Key Facts About Montreal Tech
- Number of Tech Workers: 255,000+ (2024, Tourisme Montréal)
- Major Tech Employers: SAP, Google, Microsoft, Cisco
- Key Industries: Artificial intelligence, machine learning, cybersecurity, cloud computing, web development
- Funding Landscape: $1.47 billion in venture capital funding in 2024 (BetaKit)
- Notable Investors: CIBC Innovation Banking, BDC Capital, Investissement Québec, Fonds de solidarité FTQ
- Research Centers and Universities: McGill University, Université de Montréal, Concordia University, Mila Quebec, ÉTS Montréal