Senior AI LLM Engineer (Sandton)

2 hours ago 3

Build what’s next in AI.

Join an innovative technolog
y environment focused on developing intelligent, AI-powered conversational solutions that are shaping the future of how people interact with technology.
This is a hands-on opportunity to work across LLMs, voice agents, automated testing, AI coding tools, and modern software development practices. You’ll take on complex technical challenges, contribute to solution design, and help turn ambitious AI concepts into scalable, production-ready solutions.
For a Senior AI Engineer who enjoys solving challenging problems, working with emerging technology, and having a meaningful impact on technical direction, this is an opportunity to step into a role where your expertise can make a real difference.

Must-have skills and experience:

  • 5+ years engineering; 2+ years applied LLM / speech AI in production
  • Strong Python (APIs, typing/validation, testing, packaging)
  • OpenAI / Azure OpenAI (chat, structured outputs, batch patterns)
  • Azure messaging, storage, and SQL-backed services
  • Proven ownership of ambiguous, multi-system features

Strong advantages:

  • Experience with Cursor, Claude, or similar AI coding assistants
  • Voice agent stacks; latency, barge-in, end pointing awareness
  • Speech ML in production (PyTorch, Whisper, diarization, ONNX, GPU Docker)
  • vLLM / guided decoding; Kubernetes worker patterns
  • Contact-centre QA or collections domain
  • SQLAlchemy / Azure SQL; IaC awareness or strong infra collaboration

Responsibilities:

  • Build and harden real-time voice agents: modular prompts, multi-assistant flows, tool-calling, webhooks, telephony/operational concerns
  • Improve automated QA pipelines: VAD, diarization, language gating, transcription, alignment/attribution, LLM scorecard scoring
  • Implement structured LLM pipelines (schemas, batching, failure handling, score recalculation)
  • Own features in Azure Functions / Kubernetes workers: queue consumers, artifact pipelines, SQL integrations
  • Contribute to post-call intelligence features such as outcome scoring, summary generation, and structured data extraction
  • Expand and maintain evaluation suites (scenarios, LLM-as-judge, CI regression)
  • Contribute to email/WhatsApp agent work with reuse of tools, outcomes, and observability

Reference number for this position is GZ61523 which is a permanent position based in Sandton offering a salary of R1.2m per annum, negotiable based on experience and ability.
Contact Garth on
az.oc.egrem-e@zhtrag or call 011 463 3633 to discuss this and other opportunities.
Are you ready for a change of scenery? We are a specialist niche recruitment agency. We offer our candidates a wide range of opportunities, ensuring we successfully match the right technology professionals with the right roles.

Do you know a developer or technology specialist looking for a new opportunity? We pay cash for successful referrals!

Posted on 09 Sep 10:05, Closing date 8 Nov

Or apply with your Biz CV

Create your CV once, and thereafter you can apply to this ad and future job ads easily.

e-Merge IT Recruitment

e-Merge is a service orientated, boutique agency working in specific technology verticals. We only recruit within our specialised fields, assuring both client and candidate of expert attention, knowledge and advice.

Intermediate AI LLM Engineer

Sandton
Ready to take your AI engineering career to the next level? Join a specialist technology environment at the forefront of building and improving AI-driven...

e-Merge IT Recruitment

Lead AI LLM Engineer

Sandton
Ready to take the lead in building the next generation of AI-powered solutions? This is an exciting opportunity for a Lead AI Engineer to join a dynamic technology...

e-Merge IT Recruitment

Lead AI Engineer

Sandton
Are you passionate about building production-grade enterprise AI solutions and turning cutting-edge AI technologies into real-world business solutions? We’re...

e-Merge IT Recruitment

Maintenance Engineer

East Rand
The successful candidate will be responsible for the mechanical and electrical installation, preventative maintenance, fault diagnosis, and repair of high speed sheet...

Worldwide Positions

Senior Data Engineer

Johannesburg
A large marketing data generation and distribution company, transforming how businesses access, manage and use data — are rapidly expanding their footprint...

e-Merge IT Recruitment

Claude Code AI Data Engineer

Johannesburg
We are seeking a highly capable Data Engineer with strong experience in scalable data platforms, large-scale scraping, LLM integrations, and agentic AI systems.

e-Merge IT Recruitment

Claude Code AI Data Engineer

Johannesburg
We are seeking a highly capable Data Engineer with strong experience in scalable data platforms, large-scale scraping, LLM integrations, and agentic AI systems.

e-Merge IT Recruitment

Network Engineer

Rosebank
A leading producer of platinum group metals is seeking a high-calibre Network Engineer to join its progressive, technology-driven environment.

e-Merge IT Recruitment

Senior AI Engineer

Pretoria
A global technology organisation focused on delivering innovative digital solutions, intelligent technology, and business transformation to organisations operating in...

e-Merge IT Recruitment

Senior Devops Engineer

Johannesburg
If you can make AWS, automation and CI/CD work together without needing three coffees, a prayer and a reboot… we want to hear from you!...

e-Merge IT Recruitment

Senior Cloud Data Engineer

Johannesburg
Are you passionate about building scalable data platforms that power intelligent decision-making? Join an innovative, fast-growing technology team where you'll design...

e-Merge IT Recruitment

AI Product Engineer

Centurion
A leading innovative organisation is seeking a skilled AI Product Engineer to join their team and help them design, build, and scale AI-powered solutions that transform...

e-Merge IT Recruitment

AI Product Engineer

Johannesburg
We're looking for an AI Product Engineer to design, build, deploy, and continuously improve AI-powered products that deliver measurable business value.

e-Merge IT Recruitment

Business Intelligence (BI) Engineer

Johannesburg
We are seeking a skilled Business Intelligence (BI) Engineer to design, build, and maintain scalable data pipelines and analytics solutions.

e-Merge IT Recruitment

Software Engineering

Cape St Francis
Join a purpose-driven technology organisation that is transforming the way millions of people access and manage financial services across Africa.

e-Merge IT Recruitment

Data Engineer

Johannesburg
Our client is seeking a highly skilled Data Engineer to join their DataWorks team.

e-Merge IT Recruitment

AI Engineer

Johannesburg
A consulting firm is seeking a highly motivated AI Engineer to design, develop, deploy, and maintain intelligent systems that leverage machine learning, deep learning...

e-Merge IT Recruitment

Software Quality Engineer

Johannesburg
Join a leading global software solutions environment that is passionate about delivering innovative, high-quality technology to clients across the financial services...

e-Merge IT Recruitment

Junior Data Engineer

Johannesburg
Are you passionate about data, automation, and technology? We are looking for a highly capable and intellectually curious Junior Data Engineer to join our innovative tax...

e-Merge IT Recruitment

Operations Manager

Tshwane (Pretoria)
Company Pt Operational Services Location Hatfield Pretoria Reports to Chief Executive Officer Purpose To overall

The Tolcon Group

More jobs

Read Entire Article