Horst Polomka’s Post

First try of 'DeepSeek-R1-Distill-Qwen-32B-MLX-8Bit'. It's quite impressive! Please have a look at the attached chat history and also the system load. What's your opinion?

Automatically preserve chat history beyond the size of your token window with our Chat Summary Memory Buffer! Long-running chats can easily exceed this size of your token window. Truncating the oldest entries in the chat log works, but can lose valuable context. This technique instead keeps a running summary of the pertinent facts available at all times without exceeding your available space. Check it out: https://lnkd.in/dj3SpGjQ

Latest trend is to leverage LLMs for self-reflection...ask your model of choice to analyze your chat history.

LangChain Series. Part 02: how to keep chat memory using LangChain

In this part of the video series, we make sure when we select a chat listed in our chat history we can navigate to that chat page and display all saved chats there... https://lnkd.in/eKm5iiid

My latest RAG Deep Dive session was "Storing chat history", and here's what you need to catch up! Recording: https://lnkd.in/g9NPy9ew Slides: https://lnkd.in/grA3WvhA Outline: * Handling message history in the RAG flow with token-based truncation to fit in the context window * Storing chat history in the browser for non-logged in users using IndexedDB * Storing chat history in Cosmos DB for logged in users, based off their Entra User ID

There is still quite a gap for most organizations between the promise of these new GenAI tools, and actually putting them into practice generating value. Palantir's Foundry with AIP looks to be a way to deploy powerful tools without significant in-house coding capabilities.

While everyone’s racing to AI-everything, Here’s some new competitive advantages: – Being a real person in site live chat – Emailing back quickly as a real human – DMing thoughtful, unautomated messages – Commenting like you actually read the post – Remembering and sharing interests with them – Recognising their register, speaking as they do Y’know, real human stuff. So easy to do, Yet so effective. (Do you do any of these things?)

We’ve added a helpful new feature to Qodo Gen: Chat History. Now, your conversations can carry over between sessions, letting you refer back to previous chats without losing track. Whether you’re picking up an old task or continuing a discussion, Chat History ensures everything stays connected, helping you work more efficiently. 🔗 Read the full blog: https://lnkd.in/eH8Mb6sQ

In this part of the video series, with the two models we created in the previous part, we create and write the endpoint that allows us to create & manage chats and also store them as chat history https://lnkd.in/dURqn_hm