ASAI job platform logo
  1. Home
  2. /Jobs
  3. /Machine Learning Engineer Jobs in Bengaluru
  4. /Backend / ML-Ops Engineer — Speech Model Deployment & Inference Optimization
OutcomesAI

Backend / ML-Ops Engineer — Speech Model Deployment & Inference Optimization

Bengaluru · Senior

Older listing - lower visibility likelyVerified listingPosted 332d ago

Applicants who checked fit first are 3.1× more likely to hear back

Your match scoreCalculated · locked
86Overall
64Skills
97Experience

Your score for this role already exists

ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.

No credit card · 1 tap with Google

What we know about this role

Hiring pulse

LOW

OutcomesAI is showing limited hiring activity lately. Expect slight delayed response.

Apply window

First 72 hours

Window passed - posted 332d ago

Early applicants get seen before the pile builds.

Not a repost

The first time we've seen this listing - it hasn't been closed and reopened.

Skills required

16 listed
Clinical Decision SupportRemote Patient MonitoringNatural Language UnderstandingRemote MonitoringAcute CareSpeech RecognitionHealth SystemsPacket Loss+8 more
Clinical Decision SupportRemote Patient MonitoringNatural Language UnderstandingRemote MonitoringAcute Care

You almost certainly match several of these already. Unlock your skill map to see the matches, the gaps, and what to fix first.

Job description

OutcomesAI is a healthcare technology company building an AI-enabled nursing platform designed to augment clinical teams, automate routine workflows, and safely scale nursing capacity.
Our solution combines AI voice agents and licensed nurses to handle patient communication, symptom triage, remote monitoring, and post-acute care — reducing administrative burden and enabling clinicians to focus on direct patient care.

Our core product suite includes:
● Glia Voice Agents – multimodal conversational agents capable of answering patient calls, triaging symptoms using evidence-based protocols (e.g., Schmitt-Thompson), scheduling visits, and delivering education and follow-ups.
● Glia Productivity Agents – AI copilots for nurses that automate charting, scribing, and clinical decision support by integrating directly into EHR systems such as Epic and Athena.
● AI-Enabled Nursing Services – a hybrid care delivery model where AI and licensed nurses work together to deliver virtual triage, remote patient monitoring, and specialty patient support programs (e.g., oncology, dementia, dialysis).

Our AI infrastructure leverages multimodal foundation models — incorporating speech recognition (ASR), natural language understanding, and text-to-speech (TTS) — fine-tuned for healthcare environments to ensure safety, empathy, and clinical accuracy. All models operate within a HIPAA-compliant and SOC 2–certified framework. OutcomesAI partners with leading health systems and virtual care organizations to deploy and validate these capabilities at scale. Our goal is to create the world’s first AI + nurse hybrid workforce, improving access, safety, and efficiency across the continuum of care.

Own the infrastructure and pipelines for integrating trained ASR/TTS/Speech-LLM models into production. Focus on scalable serving, GPU optimization, monitoring, and continuous improvement of inference latency and reliability.


What You’ll Do
  • Containerize and deploy speech models using Triton Inference Server with TensorRT/FP16 optimizations.
  • Develop and manage CI/CD pipelines for model promotion (staging → production).
  • Configure autoscaling on Kubernetes (GPU pools) based on active calls or streaming sessions.
  • Build health and observability dashboards: latency, token delay, WER drift, SNR/packet loss monitors.
  • Integrate LM bias APIs, failover logic, and model switchers for fallback to larger/cloud models.
  • Implement on-device or edge inference paths for low-latency scenarios.
  • Collaborate with AI team to expose APIs for context biasing, rescoring, and diagnostics.
  • Optimize GPU/CPU utilization, cost optimization, and memory footprint for concurrent ASR/TTS/Speech LLM workloads.
  • Maintain data and model versioning pipelines with MLflow, DVC, or internal registries.


  • Desired Skills
  • Experience with Triton, TensorRT, Docker, Kubernetes, and GPU scheduling.
  • Familiarity with speech inference (streaming ASR, TTS pipelines).
  • Proficient in Python, Bash, and cloud services (AWS/GCP/Azure).
  • Understanding of observability stacks (Prometheus, Grafana, ELK).
  • Knowledge of DevSecOps, access policies, and PHI-safe environments.
  • Interest in inference optimization, mixed precision, and quantization.


  • Qualifications
  • B.Tech / M.Tech in Computer Science or related field.
  • 4–6 years of experience in backend or ML-ops; at least 1–2 years with GPU inference pipelines.
  • Proven experience deploying models to production environments with measurable latency gains.
  • Free · no signup

    Get tomorrow's jobs before you have to search

    Daily job drops, skill trends and free resources - posted straight to the group. Leave any time.

    Join WhatsAppJoin Telegram

    No spam. Just jobs and resources.

    Why people use ASAI

    Someone shared one job with you. ASAI keeps finding the rest.

    • Scored, not searched. Every role ranked against your actual profile.

    • Alerts as often as hourly. Reach new roles while the pile is still small.

    • Skill gaps, spelled out. See exactly which requirements you don't meet yet.

    • Verified jobs, only. Say no to ghost jobs. Your time deserves respect.

    More Machine Learning Engineer roles in Bengaluru

    See all

    Consultant - AI developer

    KPMG India · Bengaluru

    Director, AI Engineering

    Couchbase, Inc. · Bengaluru

    ML Engineer (Intelligence) - Bengaluru

    ClanX · Bengaluru

    Snowflake Cortex AI Engineer

    Dxctechnology · Bengaluru

    Keep browsing

    All Machine Learning Engineer jobs in Bengaluru

    Two ways in

    Applicants who checked fit first are 3.1× more likely to hear back

    Your match scoreCalculated · locked
    86Overall
    64Skills
    97Experience

    Your score for this role already exists

    ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.

    No credit card · 1 tap with Google

    Free · no signup

    Get tomorrow's jobs before you have to search

    Daily job drops, skill trends and free resources - posted straight to the group. Leave any time.

    Join WhatsAppJoin Telegram

    No spam. Just jobs and resources.

    Why people use ASAI

    Someone shared one job with you. ASAI keeps finding the rest.

    • Scored, not searched. Every role ranked against your actual profile.

    • Alerts as often as hourly. Reach new roles while the pile is still small.

    • Skill gaps, spelled out. See exactly which requirements you don't meet yet.

    • Verified jobs, only. Say no to ghost jobs. Your time deserves respect.

    ASAI job platform logo

    A job platform finally, balanced in your favour.

    Jobs by CityJobs by CompanyGuidesHow We VerifyAboutPrivacy PolicyTerms of Service

    Built in India 🇮🇳

    © 2026 ASAI. All rights reserved.