AI RAG DevOps / Developer in AI SaaS Product Company

ROIFORCIO GmbH is an Austrian AI SaaS company (R&D in Ukraine) seeking an AI RAG DevOps/Developer for the Pitch Avatar product team. The role involves leading the migration and optimization of RAG infrastructure while building intelligent avatar systems that enhance training, presentations, and sales.

• Lead RAG migration from AWS OpenSearch to Zilliz Cloud (Milvus) or similar enterprise solutions to reduce costs and improve speed
• Optimize ingestion pipeline to ensure content addition (up to 10MB) takes no more than 10 seconds
• Achieve latency optimization for Avatar responses (LLM + RAG) under 2-3 seconds while maintaining relevance
• Develop multimodal data processing pipelines for parsing and indexing diverse file formats (documents, audio, video) in multiple languages
• Implement hybrid search logic to query both unstructured vector data and structured relational data (SQL/Tables) simultaneously
• Prepare architecture for future multi-cloud support (Azure, GCP) and external RAG source integration
• Manage deployment of AI services, ensuring stability in multi-tenant environments
• Support integration of future technologies like MCP and local LLMs

• 3+ years of Backend Development experience (Python or Golang)
• 1+ year of practical experience building and maintaining RAG systems in production
• Deep experience with Vector Databases: Zilliz Cloud/Milvus (priority), Weaviate, Qdrant, or Pinecone
• Proven track record optimizing RAG performance and achieving low-latency search (<3s)
• 2+ years strong experience with AWS infrastructure; knowledge of Azure and GCP preferred
• 2+ years DevOps experience: containerization, deployment, managing cloud resources for AI workloads
• Experience handling multimodal content: PDF, XLS, MS Word, PPTX, TXT, MP3, MP4
• Experience with structured data integration and hybrid search (LLMs to relational DBs and SQL tables)
• Experience creating MVPs from scratch and customizing solutions
• Understanding of MCP and Local LLM deployment is a plus
• English at B1+ level minimum (B2 required)

Schedule: Full remote work

Work Type: Contract of Private Entrepreneur with Austrian company

Team: Distributed team

Environment: Early-stage startup with access to product at pitchavatar.com