HireFT
Browse JobsHow it worksPricingAboutSuccess Stories
    Back to jobs
    RE

    Realm Labs

    Artificial Intelligence

    Software Engineer

    Sunnyvale, United StatesOn-SiteFull-time2+ yrs experiencePosted 1mo ago
    All Realm Labs jobs

    Job description

    About Realm Labs

    Realm Labs is building the infrastructure that makes AI safe for enterprises. Our platform helps organizations securely deploy, monitor, and govern AI applications through real-time detection, policy enforcement, and security controls.
    Our systems process billions of AI tokens across production workloads and solve challenging problems in distributed systems, inference infrastructure, security, and developer tooling.
    We’re a small, engineering-driven team where every engineer owns meaningful pieces of the product and works directly with customers.

    What You’ll Do

    As a Software Engineer at Realm Labs, you’ll build production systems that power enterprise AI deployments. Your work will span backend services, distributed systems, infrastructure, and customer-facing features.
    Responsibilities include:
    • Design and build scalable backend services in Python or Go.
    • Develop APIs and internal services used by enterprise customers.
    • Work with distributed systems, asynchronous processing, and message queues.
    • Design efficient database schemas and optimize query performance.
    • Build reliable integrations with cloud services and AI platforms.
    • Debug production issues and improve system reliability and observability.
    • Collaborate closely with product, infrastructure, and AI engineers to ship features quickly.
    • Participate in code reviews and help maintain a high engineering bar.

    What We’re Looking For

    Required
    • 2+ years of professional software engineering experience.
    • Bachelors of Science in Computer Science or equivalent degrees.
    • Strong programming skills in Python, Go, Java, C++, or a similar language.
    • Solid understanding of computer science fundamentals, including:
      • Data structures and algorithms
      • Operating systems
      • Concurrency and multithreading
    • Experience designing and consuming REST or gRPC APIs.
    • Experience working with relational databases such as PostgreSQL or MySQL.
    • Understanding of distributed systems concepts such as replication, consistency, caching, partitioning, queues, and fault tolerance.
    • Experience with cloud platforms (AWS, GCP, or Azure).
    • Strong debugging and problem-solving skills.
    • Excellent communication skills and ability to work in a fast-moving startup.
    Nice to Have
    • Experience building distributed systems at scale.
    • Experience with Docker and Kubernetes.
    • Familiarity with Redis, RabbitMQ, Kafka, or similar technologies.
    • Experience with observability tools (OpenTelemetry, Prometheus, Grafana).
    • Experience with AI/LLM infrastructure.
    • Experience working in startups or shipping customer-facing products.

    Technologies We Use

    You don’t need experience with everything below, but you’ll likely work with many of them:
    • Python
    • Go
    • PostgreSQL
    • Redis
    • Docker & Kubernetes
    • AWS, GCP, Azure
    • FastAPI
    • Terraform
    • GitHub Actions
    • OpenTelemetry
    • LLM APIs and inference infrastructure

    What We Value

    We’re looking for engineers who:
    • Take ownership from idea to production.
    • Care about writing clean, maintainable code.
    • Think systematically about reliability and scalability.
    • Enjoy learning new technologies.
    • Move quickly without sacrificing quality.
    • Are excited about building products in the AI infrastructure and security space.

    Why Join Realm Labs?

    • Build foundational infrastructure for the next generation of AI applications.
    • Solve challenging distributed systems and infrastructure problems.
    • Work directly with experienced engineers from companies like Google, Apple, Microsoft, and leading security organizations.
    • High ownership with significant impact from day one.
    • Competitive salary and meaningful equity.
    • Opportunity to help define the future of enterprise AI security.

    Job details are sourced from the employer's original posting.

    Open job posting
    RE

    About the company

    Realm Labs

    Realm Labs is a company focused on developing and optimizing LLM inference infrastructure, with expertise in areas like PyTorch, TensorFlow, and GPU inference optimization.

    View all Realm Labs jobs
    Industry
    Artificial Intelligence
    Open roles
    5

    Interested in this role?

    Apply with HireFT

    Free to start — no card required.

    Your fit

    How well do you match?

    Sign in to see how your résumé lines up with this role.