.Net: Hybrid Compute - Memory

[markwallace-microsoft]

Implement a hybrid model orchestration within Semantic Kernel to leverage both local and cloud models. The system should default to local models for inference where available and seamlessly fall back to cloud models. Additionally, it should support local memory storage and retrieval, using cloud-based solutions as a fallback or for additional backup. This hybrid strategy should be abstracted within the Semantic Kernel, enabling developers to specify preferences and priorities without managing the underlying complexities. This should build on top of the capabilities we already have.

Scenarios

• As a developer, I want my application to store and retrieve memory locally where capacity and compliance allow, reverting to cloud-based storage as a secondary option.

Requirements

Memory Management:

• Implement a dual-layer memory management system where data can be stored locally (on-premises storage solutions) with a fallback to cloud-based memory storage.
• Provide synchronization mechanisms to ensure consistency between local and cloud memory storage.