Backend Engineer, Core

About the role

The Core Backend Engineer works on the Obrew engine — the foundational platform that powers FileBuff and all other OpenBrew applications and 3rd party webapps. You'll build the infrastructure layer: model serving, document processing, embedding pipelines, and the APIs that product teams build on top of. This role is ideal for someone who loves systems design and wants to solve hard problems at the intersection of distributed systems and local AI inference.

What you'll do

• Design and build core Obrew engine services for model inference, embedding, and data processing
• Architect and maintain the data ingestion pipelines that all Obrew apps depend on
• Build and evolve the Obrew API layer consumed by the app suite and third-party developers
• Optimize the local inference runtime for throughput, latency, and memory efficiency across heterogeneous hardware configurations
• Implement monitoring, alerting, and observability for the core engine

Qualifications

• Applicant MUST be a U.S. citizen and reside in the U.S. while performing work
• 3+ years of backend engineering experience
• Strong proficiency in Python and/or C++
• Knowledge of REST, GraphQL, or gRPC communication protocols
• Experience building and optimizing data processing or inference pipelines
• Understanding of vector databases, embedding generation, and document ingestion workflows
• Familiarity with message queues, task orchestration, and async processing
• Experience designing APIs consumed by multiple product teams or external developers
• Experience with Natural Language Processing techniques and implementations
• Must work collaboratively with others who possess diverse skillsets and beliefs

Nice to have

• Experience with Rust or Go for performance-critical services
• Familiarity with llama.cpp, vLLM, ONNX or other local inference runtimes
• Experience optimizing for memory efficiency and hardware-aware performance tuning
• Experience building platform-level services that other teams build on top of
• Familiarity with high security and compliance industries (Healthcare, Government, Defense)

Benefits

• Competitive salary
• Flexible hours
• Training and professional development