Data In Motion: September 2024

9-September-2024

Tim Spann @PaaSDev Milvus - Attu - Feder - GPTCache - VectorDB Bench https://linktr.ee/Milvusio

AIM Weekly (Attu - Milvus (Tim-Tam))

https://www.technologyreview.com/2024/08/22/1097224/we-finally-have-a-definition-for-open-source-ai?

TL;DR --- But you should #154 - 09-September-2024

📎 Mistral Nemo
🤖 Evaluating LLM Conversations
📊 Building with NVIDIA and Milvus
📱 Rag Evaluation using Ragas
🖥️ AnythingLLM
📢 RDBMS vs Vector DB
🖥️ LLMWare
🐦‍🔥NIM Agent Buildprints

Upcoming

🌧️ Sept 12: Virtual: Voxel51
🗽 Sept 18: NYC: Unstructured Data Meetup NYC
🍕 Sept 19: NYC: AI Camp NYC
🧠 Sept 19: Virtual RAG Pipelines with Real-Time
🚕 Oct 23: NYC: Unstructured Data Meetup NYC
📡 Oct 27-29: Raleigh, NC: All Things Open
🔥 Milvus 2.4.10 (RBAC for CDC, Database Access Restrictions, Upsert with Auto ID, Field Partial Load Collection [Beta Preview])

Last Week

🖥️ Princeton AI
🌃 Princeton AI Report
🌆 MultiVector Advanced Search

Apps, Demos, Examples, Models, Notebooks and Projects

🚀 Partitioning Data for Performance by @ Tim Spann 🚀 Air Quality Applications & Notebook by @ Tim Spann
🤖 Milvus Partitioning by @ Tim Spann
💰 [https://www.youtube.com/watch?v=IiuxKARtDeQ](Fun Friday Discussion) by @ Chris & Tim
👽 [https://www.youtube.com/watch?v=4ta842VAyIM](Challenges in Structured Document Data Extraction at Scale with LLMs)

Connect with Us

CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/unstructured-data-meetup-new-york/?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

https://forms.gle/96nwiyt9LWGfAXxs5

This is Issue #154

Join us at the next meetup in September.

Featured Tool

Check out the RAGBuilder Github repo: https://github.com/KruxAI/ragbuilder

Webinar Coming

Sept 12 https://voxel51.com/computer-vision-events/ai-machine-learning-computer-vision-meetup-sept-12-2024/

Sept 19 https://zilliz.com/event/rag-pipelines-with-real-time-data

New Zilliz Cloud

https://docs.zilliz.com/docs/release-notes-2100

VectorDB Basics:

What are Vector Databases, and How Do They Work?

Vector Databases vs. Relational Database

Vector Database vs Graph Database

Compare Vector Databases, Vector Search Libraries, and Plugins

What Are Vector Embeddings?

Introduction to Vector Similarity Search

How to evaluate a vector database?

Benchmark Vector Database Performance: Techniques & Insights

Vector Database Benchmark tools:

VectorDBBench: Open-Source Vector Database Benchmark Tool

ANN Benchmarks

Everything you want to know about RAG

What is RAG?

OpenAI RAG vs. Your Customized RAG: Which One Is Better?

Will RAG Be Killed by Long-Context LLMs?

Optimizing RAG Applications: A Guide to Methodologies, Metrics, and Evaluation Tools for Enhanced Reliability

How to Evaluate RAG Applications

Vector Databases Are the Base of RAG Retrieval

RAG Enhancement techniques and tools:

Enhancing RAG with Knowledge Graphs

Optimizing RAG with Rerankers: The Role and Trade-offs

What is GraphRAG? Enhancing RAG with Knowledge Graphs

Building On-Prem RAG for Data Security

Crafting Highly Efficient RAG with DSPy

Build a RAG agent with an extended LLM context window using MemGPT

RAG tutorials

Local RAG Setup with Llama 3, Ollama, Milvus & LangChain

Build a Multimodal RAG with Gemini, BGE-M3, Milvus and LangChain

Building Intelligent RAG Applications with LangServe, LangGraph, and Milvus

Local Agentic RAG with LangGraph and Llama 3

A Guide to Chunking Strategies for Retrieval Augmented Generation (RAG)

Building RAG with Milvus, vLLM, and Meta’s Llama 3.1

Embedding, ML, and AI

Top Performing AI Models for Your GenAI Apps | Zilliz

How to Choose the Right Embedding Model for Your Data

Evaluating Your Embedding Model

Training Your Own Text Embedding Model - Zilliz blog

Generative AI Resource Hub | Zilliz

Articles

Partitioning Collections by Name https://medium.com/@tspann/partitioning-collections-by-name-395eb48a2238

Report: Building the Future of Startups - Enhanced with Vector Databases and AI https://medium.com/@tspann/report-building-the-future-of-startups-enhanced-with-vector-databases-and-ai-aa3bf6d06bdc

Multiple Vectors and Advanced Search Data Model Design https://dzone.com/articles/multiple-vectors-and-advanced-search-data-model-design

Multi-Vector Search https://medium.com/@tspann/utilizing-multiple-vectors-and-advanced-search-data-model-design-for-city-data-705d68d8daf2

What's in the Air Tonight, Mr. Milvus. (Air Quality + Vector Database + RAG) https://medium.com/@tspann/whats-in-the-air-tonight-mr-milvus-fbd42f06e482

Build a Rag App with NVIDIA NIM and Milvus https://thenewstack.io/build-a-rag-app-with-nvidia-nim-apis-and-a-vector-database/?

September 18, 2024: Unstructured Data Meetup NYC https://lu.ma/9o3la3gf

https://allevents.in/manhattan/unstructured-data-meetup-new-york/80001083991651?ref=smdl

September 19, 2024: AI Camp NYC https://www.aicamp.ai/event/eventdetails/W2024091915

September 26, 2024: Conf42 Kube Native https://www.conf42.com/Kube_Native_2024_Tim_Spann_cloud_native_open_source_vector_databases

September 26, 2024: Streamnative Partner Webinar

October 23, 2024: Unstructured Data Meetup NYC https://lu.ma/naqu6xrd

October 27 - 29, Raleigh, NC - All Things Open https://2024.allthingsopen.org/speakers/timothy-spann https://2024.allthingsopen.org/sessions/advanced-retrieval-augmented-generation-rag-techniques

October 31 - Live stream from my Halloween decorations with three 12 foot skeletons

November 5-7, 10-12, 2024: CloudX. Online/Santa Clara. https://www.developerweek.com/cloudx/

November 15, 2024: Build Stuff. Online. Adding Generative AI to Real-Time Streaming Pipelines https://www.developerweek.com/cloudx/speakers/

November 19, 2024: XtremePython. Online. https://xtremepython.dev/2024/

November 21, 2024: Big Data Conference 2024 EU

https://events.pinetool.ai/3254/#sessions/108389?referrer%5Bpathname%5D=%2Fsessions&referrer%5Bsearch%5D=&referrer%5Btitle%5D=Sessions

November 21, 2024: Unstructured Data Meetup NYC https://lu.ma/cqxuproe

December 4, 2024: Grace Hopper Celebration - Open Source - Milvus https://ghc.anitab.org/open-source/

December 10, 2024: Unstructured Data Meetup NYC https://lu.ma/u2ijucyv

Code

Models

Tools


🖥️ Videos: https://www.youtube.com/@MilvusVectorDatabase/videos

X Twitter -   / milvusio  https://x.com/milvusio

🔗 Linkedin:  / zilliz  https://www.linkedin.com/company/zilliz/

😺 GitHub: https://github.com/milvus-io/milvus

🦾 Invitation to join discord:   / discord  https://discord.com/invite/FjCMmaJng6

https://discord.gg/9jdMRPJb?event=1273364262710022209

Data In Motion

AI Dev Day - NYC 2023

AIM Weekly for 16 Sept 2024

16-September-2024

AIM Weekly (Attu - Milvus (Tim-Tam))

TL;DR --- But you should #155 - 16-September-2024

Upcoming

Last Week

Apps, Demos, Examples, Models, Notebooks and Projects

Connect with Us

CODE + COMMUNITY

Webinar Coming

Events

Code

Models

Tools

Fun Unstructured Friday - 13 September 2024

Computer Vision Meetup: It's in the Air Tonight. Sensor Data in RAG

How do you host successful dev-centric meetups? Interview with Developer...

AIM Weekly 09 Sept 2024

9-September-2024

AIM Weekly (Attu - Milvus (Tim-Tam))

TL;DR --- But you should #154 - 09-September-2024

Upcoming

Last Week

Apps, Demos, Examples, Models, Notebooks and Projects

Connect with Us

CODE + COMMUNITY

Featured Tool

Webinar Coming

Articles

Videos

Slides

Events

Code

Models

Tools