Prompt Engineer

Company: Superbill, Inc.
Location: San Mateo
Posted on: May 20, 2025

Job Description:

We're looking for a Prompt Engineer to help us unlock the full potential of large language models in real-world healthcare workflows. If you love experimenting with LLMs, working closely with product and engineering teams, and obsessing over real user outcomes-this role is for you.About the Role:

• Design, iterate, and optimize prompts that drive LLM behavior in production settings-spanning classification, summarization, structured extraction, and workflow automation.
• Collaborate with engineers, product managers, and customers to translate domain problems (e.g. prior auth, claim appeals, denials) into robust LLM-powered solutions.
• Build and maintain internal tooling for prompt versioning, testing, and performance evaluation (accuracy, latency, cost).
• Fine-tune and evaluate models where needed using structured feedback and real-world data.
• Analyze edge cases and failure modes; design prompt strategies to improve resilience and alignment with business logic.
• Stay current on the LLM ecosystem and incorporate best practices into our architecture.About You:
  • 1+ year of experience in a software engineering, ML, NLP, or LLM-centric role.
  • Deep understanding of prompt design patterns and LLM capabilities/limitations across GPT-4, Claude, Mistral, etc.
  • Hands-on experience with LangChain, LlamaIndex, PromptLayer, or similar frameworks.
  • Strong Python skills and comfort working in a codebase (bonus: experience with backend workflows or vector DBs like Weaviate/Pinecone).
  • Obsession with quality-you're comfortable writing tests, measuring performance, and debugging model behavior with structured rigor.
  • Bonus: Exposure to healthcare data, terminology (EHRs, RCM, FHIR), or compliance-aware deployments.What's in it for you?
    • Build AI that has real impact - help reduce burnout and drive efficiency in healthcare systems that affect millions.
    • Work with a small, high-velocity team obsessed with shipping.
    • Shape the future of our AI stack from the ground up.
    • Competitive compensation + meaningful equity + healthcare benefits.Who we are:SuperDial is transforming AI in healthcare by building scalable, AI-powered solutions that optimize revenue cycle management. Join us and help shape the future of AI in healthcare!The base salary for this role ranges from $85,000 to $115,000, depending on experience, skill set, and fit. We also offer equity and benefits as part of our total compensation package. Final offers may vary based on experience and qualifications - we're always open to exceptional talent.
      #J-18808-Ljbffr

Keywords: Superbill, Inc., Newark , Prompt Engineer, Engineering , San Mateo, California