hybrid
Thesis: Human-in-the-Loop Sanitization for Hybrid Local and Cloud LLM Agents under Data Sovereignty Constraints
AI Engineer
High Level Description Many Swedish public authorities cannot send sensitive information to cloud LLM services. At the same time, the hardware needed to run open models that come close to the leading cloud models on-premise is expensive, and the smaller models that are affordable to run locally are less capable. This thesis aims to investigate a hybrid setup where a small local model does the work and, when it gets stuck, asks a cloud model for help through an anonymizing step that a human appro
About the role
High Level Description
Many Swedish public authorities cannot send sensitive information to cloud LLM services. At the same time, the hardware needed to run open models that come close to the leading cloud models on-premise is expensive, and the smaller models that are affordable to run locally are less capable.
This thesis aims to investigate a hybrid setup where a small local model does the work and, when it gets stuck, asks a cloud model for help through an anonymizing step that a human approves. Nothing leaves the network until it has been sanitized and approved.
Project Description
In this thesis, investigate and build an escalation path from a local coding agent to a cloud LLM within an agentic coding harness. When the local agent needs help, its question passes a sanitization step that removes or generalizes sensitive details, for example rewriting the Java package se.foretag to
Skills
agentic aiaicloudgdprjavallm