Skip to content

PolarSPARC

Articles | Notes | Tips | Tutorials

PolarSPARC

Quick Primer on Llama.cpp

In this primer, we will provide an overview of the llama.cpp inference platform and get our hands dirty in using it. We will use the Langchain OpenAI module in Python to test the platform.

Here is the link to the article on llama.cpp:

Quick Primer on llama.cpp

Enjoy 🙂 !!!

Author bhaskar_sPosted on June 29, 2025Categories Docker, LangChain, Llama.cpp, LLM, PythonTags docker, langchain, llama.cpp, llm, python

Post navigation

Previous Previous post: Pragmatic Bytes on Spring AI
Next Next post: Hyperledger Besu Private Network using Docker

Comments

  • Sridhar on Quick Tip :: Running Text-to-Image Diffusion Model on a Local Machine
  • Sridhar on Introduction to Apache Calcite
  • Sridhar on Introduction to Deep Learning – Part 7
  • Sridhar S on Introduction to Deep Learning – Part 1
  • bhaskar_s on Machine Learning – Understanding Ensemble Learning
  • Sridhar on Machine Learning – Understanding Ensemble Learning
  • Sridhar on Machine Learning – Decision Trees using Scikit-Learn
  • Sridhar S on Machine Learning – Polynomial Regression using Scikit-Learn – Part 3
  • Sridhar S on Machine Learning – Understanding Bias and Variance – Part 4
  • Sridhar M Seetharaman on Hands-on with eBPF

Categories

  • Agentic (5)
  • Algorithm (4)
  • Android (14)
  • Ansible (4)
  • ARM (16)
  • AWS (19)
  • Besu (1)
  • BigData (25)
  • Blockchain (15)
  • BPF (1)
  • C++ (3)
  • Calcite (1)
  • Cassandra (5)
  • Chaincode (1)
  • Chatbot (3)
  • Cloud (51)
  • Containers (13)
  • Cryptography (3)
  • Data Structure (3)
  • Database (18)
  • DataScience (53)
  • DeepLearning (26)
  • DevOps (5)
  • Diffusion (1)
  • Docker (30)
  • Ethereum (9)
  • Finance (2)
  • General (44)
  • Golang (9)
  • Google Cloud (15)
  • Gradio (1)
  • GraphDB (3)
  • gRPC (4)
  • Hadoop (8)
  • Hardware (5)
  • HashiCorp (2)
  • HuggingFace (1)
  • Hyperledger (4)
  • IoT (3)
  • IPFS (1)
  • Java (103)
  • JVM (3)
  • Kafka (10)
  • Kubernetes (4)
  • LangChain (5)
  • LangGraph (1)
  • Leadership (11)
  • Links (15)
  • Linux (36)
  • Llama.cpp (1)
  • LLM (18)
  • LocalAI (1)
  • MachineLearning (25)
  • Management (3)
  • Mathematics (27)
  • MCP (1)
  • Messaging (12)
  • MongoDB (5)
  • Network (21)
  • NFT (1)
  • NLP (5)
  • NoSQL (11)
  • Ollama (12)
  • OpenFaaS (1)
  • PydanticAI (1)
  • Python (100)
  • PyTorch (12)
  • R (4)
  • RAG (2)
  • Rasa (3)
  • Raspberry Pi (2)
  • Reactive (6)
  • Scala (8)
  • Scikit-Learn (20)
  • Security (17)
  • Serverless (1)
  • Solidity (5)
  • Spark (2)
  • Spring (19)
  • SQL (5)
  • Terraform (1)
  • Vault (1)
  • VectorStore (3)
  • Virtualization (5)
  • Web (13)
  • Windows (2)

Past Archives

PolarSPARC Proudly powered by WordPress