AEGIS - VBS 2027 Video Search
Built a live-first VBS 2027 retrieval system with a 6-member RMIT team. Led performance benchmarking and the public project page.
- Role
- Performance & Benchmark Engineer
- Timeline
- 2026
- Team
- 6 Members
Highlights
- Multimodal retrieval using text descriptions, images, or short video clips.
- Conversational query refinement and relevance feedback.
- Visual question answering with frame-linked evidence and abstention when evidence is unavailable or responses are invalid.
- Intra-video timeline exploration for inspecting nearby moments.
Technology
- Python
- FastAPI / Uvicorn
- React / Vite
- TypeScript
- Tailwind CSS
- shadcn/ui / Radix
- Lucide
- Qdrant
- PyTorch / Transformers
- vLLM
- OpenAI VLM
- WeMM Embedding
- SigLIP
- YOLOE / Ultralytics
- PaddleOCR
- Whisper
- OpenCV / Pillow
- BM25 / RRF
- DRES API