Sr LLM Engineer

Job Description

• This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Sr LLM Engineer in India. This role is designed for a senior-level AI/ML professional with strong expertise in Large Language Models and Generative AI systems. You will play a key role in designing, building, and optimizing LLM-powered applications that solve real-world business problems at scale. The position involves working across the full AI lifecycle, from model experimentation and prompt engineering to production deployment and monitoring. You will contribute to the development of intelligent systems leveraging techniques such as RAG, agents, and advanced prompting strategies. In this role, you will also help define technical direction, guiding engineering teams toward scalable and efficient AI solutions. Working in a remote, long-term contract setup, you will collaborate closely with cross-functional stakeholders, including business experts and technical teams, to translate requirements into robust AI-driven products. Your work will directly influence the evolution of next-generation AI capabilities within the organization.
• Accountabilities: You will be responsible for designing, building, and optimizing LLM-based systems while contributing to the technical direction of AI initiatives. The role combines hands-on engineering with architectural and leadership responsibilities. Design and develop LLM-powered applications using modern Generative AI techniques such as prompt engineering, RAG, and agent-based systems. Build scalable machine learning and AI pipelines to support production-grade deployment of LLM solutions. Contribute to defining and executing the technical roadmap for AI/ML initiatives, guiding engineering efforts toward best practices. Develop robust backend systems using Python and SQL to support data processing and model integration workflows. Leverage LangChain and related frameworks to orchestrate LLM workflows and multi-step reasoning systems. Work with cloud platforms such as Azure, AWS, or GCP to deploy and manage scalable AI services. Collaborate with business stakeholders and SMEs to translate requirements into technical AI solutions. Ensure performance, reliability, and scalability of deployed LLM-based systems in production environments. Requirements: The ideal candidate is a senior AI engineer with strong experience in machine learning systems and hands-on expertise in Generative AI and LLM technologies. 7+ years of professional experience in Machine Learning engineering, model development, or AI system design. At least 1+ year of hands-on experience working with LLMs and Generative AI techniques. Strong practical knowledge of prompt engineering, Retrieval-Augmented Generation (RAG), and agent-based AI systems. Proficiency in Python and SQL, with experience building scalable data and ML pipelines. Hands-on experience with LangChain or similar LLM orchestration frameworks. Familiarity with cloud platforms such as AWS, Azure, or GCP for deploying AI solutions. Strong ability to define technical direction and contribute to engineering roadmap planning. Excellent communication skills and ability to collaborate effectively with business stakeholders and SMEs. Benefits: Long-term contract opportunity with remote work flexibility in India. Exposure to cutting-edge Generative AI and LLM technologies in production environments. Opportunity to shape technical strategy and influence AI roadmap decisions. Work on impactful AI-driven solutions solving real-world business challenges. Collaboration with experienced engineering and business teams in a dynamic environment. Access to modern cloud and AI tooling ecosystems (AWS, Azure, GCP, LangChain). Competitive contract-based compensation (based on experience and market standards).
• How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Why Apply Through Jobgether? Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time. #LI-CL1
• We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
• apply for this job