How to use local LLMs with R and Python using Posit's ellmer and chatlas packages
By
ionychal
A five-star bake. Worth schmearing, sharing, saving.
Summary
Posit has released two free, open-source packages—ellmer for R and chatlas for Python—that enable users to interact with large language models (LLMs). This article explains how to set up and use these packages with local LLMs via tools like Ollama, allowing organizations to run AI-powered workflows behind their own firewalls without exposing data to the open internet. The approach addresses concerns about rate limits and privacy when using external LLM services.
Key quotes
· 3 pulledPosit created ellmer and chatlas, two free and open-source packages for interacting with large language models (LLMs) in R and Python, respectively.
Many organizations now offer access to LLMs for internal use so that the prompts and responses can be behind the institution's firewall and do not cross into the open internet.
However, some institutions curb the use of those LLMs with rate limits (only allowing
You might also wanna read
OnsetLab: Open-Source Framework for Local Tool-Calling AI Agents
OnsetLab is an open-source framework that enables developers to run tool-calling AI agents locally using small language models. The platform
Product Hunt·3mo ago
Lapis: Offline AI Chat Assistant Running Open-Source LLMs Locally on Your Device
Lapis is an AI chat assistant that runs open-source large language models locally on devices, providing fully offline and private AI chat ex
Product Hunt·6mo ago
Monostate: All-in-One AI Training Platform for Fine-Tuning LLMs
Monostate is an all-in-one AI training platform that enables users to fine-tune large language models (LLMs) with their own data using vario
Product Hunt·2mo ago
Guide to Calculating GPU Memory for Self-Hosted LLM Inference
The article provides a guide on calculating GPU memory requirements and managing concurrent requests for self-hosted large language model (L
Product Hunt·9mo ago
RTP-LLM: Alibaba's High-Performance Inference Engine for Large Language Model Deployment
This paper presents RTP-LLM, a high-performance inference engine developed by Alibaba for industrial-scale deployment of Large Language Mode
arxiv.org·2d ago
Unsloth: Open-Source Platform for Local AI Model Training and Inference
Unsloth is an open-source platform that enables users to run and train AI models and large language models (LLMs) locally on their own hardw
Product Hunt·2mo ago