https://dzone.com/articles/multimodal-rag-is-not-scary-ghosts-are-scary

 https://dzone.com/articles/multimodal-rag-is-not-scary-ghosts-are-scary

Ghosts are real...

AIM Weekly @ All Things Open @ 28 October 2024

 Tim Spann @PaaSDev https://linktr.ee/Milvusio

🇺🇸 AIM Weekly (AI Native + LLM + Milvus)

#161 - 28-October-2024

Watermark and Identified AI Generated Content

🤖 SynthID
🤖 SynthID @ deepmind
🤖 SynthID with Google gemma 2b
🤖 Google Gemma 2B at HuggingFace

The Coolness this week

📎 AutoRAG with Milvus
🛠️ ADO
🫶 Self Hosting LLM
🌐 Noema Declarative AI
📝 New NIM Blueprint for building AI Virtual Assistant
🚙 Zilliz Integrations
🫶 Using Milvus for Semantic Search
🤖 Contextual Retrieval
📎 Meta: Quantized Light Weight Models
🚙 [https://arxiv.org/pdf/2407.01219](Search Paper)
✅ Cool Icons
🙌 IBM Watson AI Milvus Bot
📎 The Hacker's Browser
🛠️ Small and Mighty H2O Model
📝 Zilliz Cloud vs Qdrant
💫 Gravatino and Agents
🛠️ OSS Summit Europe 2024 Report
▶️ RAG Strategi
🤖 MS AI Data Visualizations
🌐 Graph RAG
👽 South Bay Meetup 15 Oct 2024
🦾 Influx and Milvus
👽 Multimodal Pipelines
✨ Constrained Sampling from LLM
🚕 BAML: Cheaper, Fast and More Accurate Function Calling
📊 Infinite World Generation with outlines txt
💻 Ollama Client Swift
🍔 Atomic Agents
🕶️ PYMUPDF4LLM
🚕 Milvus for AI Agents
📊 Fine Tuning LLAMA 3 with ORPO
🦾 Run NVIDIA Models
💻 LLM Training Meta Lingua
✨ 1 Bit LLM - MS BitNet
💻 Intro
🕶️ Mastering Chunk
📊 Storm Stanford Tool
🐍 DAMO NLP SG CaRing
🍔 LLM Reasoners

New Models

📊 LLAMA 3S Instruction v0.2
🔋 Torchtune / Finetuning Models
💻 Facebook Research Co-Tracker Vision
📝 LLama 3S Instruction v0.2
🕶️ OmniParse MS
🍔 Molmo 7B-D-0924 open vision-language models
📝 IBM Granite Models on Ollama
💻 Mochi 1 Video Generation
🕶️ Text to Video Open Model
🔋 QWEN 2.5 Math
📊 QWEN 2.5 - 1.5B Instruct
🐍 Janus + Tools
🍔 MIT Han Lab VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation 7B 256
🛠️ Pixtral Multimodal model
🎃 Steiner 32B interesting model
🐦 Text to Video
👽 NVIDIA customized LLama 3.1 Nemotron 70b
👻 [Stable Diffusion 3.5 Large]https://huggingface.co/stabilityai/stable-diffusion-3.5-large)
🔋 MedEmbed for medical
🍔 Extract image PHI-3 Vision 128K

Embedding Models

MedEmbed

Upcoming

🎃 Oct 31: Virtual: RAGs NiFi Webinar, halloween
📊 Nov 8: NYC: https://pydata.org/nyc2024
🐍 Nov 19: Virtual: XTreme Python

Last Week

🎃 Meetup Report
👻 DBTA Webinar with Airbyte and Milvus
🧐 Ghosts?
🐍 Move to the cloud
🐦 Attu Updates

Apps, Demos, Examples, Models, Notebooks and Projects

🐍 RAG 101
🐦 Milvus Knowledgebase
👻 AIM Ghosts
🚕 Unstructured Data - Ghosts - Part 1

CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/unstructured-data-meetup-new-york/?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

https://forms.gle/96nwiyt9LWGfAXxs5

Tips

ATTU Tip on Mac

Download
https://github.com/zilliztech/attu/releases/tag/v2.4.9

then run
sudo xattr -rd com.apple.quarantine /Applications/attu.app

Events

October 31 - Live stream from my Halloween decorations with three 12 foot skeletons

November 5-7, 10-12, 2024: CloudX. Online/Santa Clara. https://www.developerweek.com/cloudx/

November 15, 2024: Build Stuff. Online. Adding Generative AI to Real-Time Streaming Pipelines https://www.developerweek.com/cloudx/speakers/

November 19, 2024: XtremePython. Online. https://xtremepython.dev/2024/

November 21, 2024: Big Data Conference 2024 EU 

https://events.pinetool.ai/3254/#sessions/108389?referrer%5Bpathname%5D=%2Fsessions&referrer%5Bsearch%5D=&referrer%5Btitle%5D=Sessions

November 21, 2024: Unstructured Data Meetup NYC https://lu.ma/cqxuproe

December 10, 2024: Unstructured Data Meetup NYC https://lu.ma/u2ijucyv

© 2020-2024 Tim Spann https://www.youtube.com/@FLaNK-Stack

Preview of 23 October 2024 Meetup: Unstructured Data in LLMs on 25th St...

Looking at the new attu for Milvus

Step-by-Step RAG 101 with Milvus, Ollama, LLama 3.2 and Langchain

AIM Weekly 21 October 2024

 Tim Spann @PaaSDev https://linktr.ee/Milvusio

🇺🇸 AIM Weekly (AI Native + LLM + Milvus)

TL;DR --- AIM Weekly (AI + Attu + Milvus) But you should #160 - 21-October-2024

Milvus News

🫶 Amazing new features in the latest Attu for Milvus

Regular Cool AI Stuff

📝 New AI Tool for building podcast from writings
🫶 Fast HTML
🚙 Byaldi
✅ Data Version Control
🙌Keep an eye on Drasi for data change
📎 RAGatouille
🛠️ LLMWare with Milvus
📝 Yacana AI
💫 LoLCats AI
🙌 Tabled AI
🧐 Scaling Vector Databases
🦾 GoSub Engine
✅ FnCall
📎 How AI Agents are
🚙 Halloween Video
🤖 LLama Factory
👽 LLama Coder
🧐 Vision Embedding
🌐 Chat with your local codebase
🍔 Private Knowledge RAG
👽 Beyond Jupyter
🌐 Evolution of Multi Agent Systems
🗣️ Evolution of Multi Agent Systems 2
▶️ Why Small Language Models are so good
🚙 speeding up on mac silicon
🍔 LLM Explorer
🤖 Fine Tune your model
🌐 All the DNS for Download
🦾 WASM in Browser Notebook
👽 Run Marimo
🦾 LLM Evaluation
👽 Crawl4AI
✨ Lotus Vision
🚕 Milvus Unleashed a First Dive into Vector Databases
📊 Prompt Gateway
📊 gen structured text
💻 Makefile in markdown
🍔 Gravitino
👽 ELL LLM Lang
🦾 RNNs are back
🍔 This is the way to move vectors
💻 PrivateGPT
📊 Multimodal Medical RAG
📊 Pulsar App
🔋 Janus Deepseek AI
👽 Enhance OCR with YOLO10 and LLAMA 3.1
🍔 Improve RAG Context Recall
🦾 AI Agents Framework
🔌 JINA COLBert v2 Multimodal Search

New Models

🕶️ QWEN 2.5
🔋 Zamba 7B v1
💻 Open LLM Leaderboard
🕶️ PHI-3 Vision Instruct
📊 Mistral AI Edge Models
🔌 Japanese Gemma 2B
🚕 RGB-X New Gen
📱 Which model to use where

Upcoming

👻 Oct 23: NYC: Unstructured Data Meetup NYC
📊 Oct 25: NYC: BITS 2024 Conference
📱 Oct 27-29: Raleigh, NC: All Things Open
🎃 Oct 31: Virtual: RAGs NiFi Webinar, halloween
📊 Nov 8: NYC: https://pydata.org/nyc2024
🐍 Nov 19: Virtual: XTreme Python

Last Week

👻 Streamnative + Zilliz Podcast
🧐 Advanced Retrieval Augmented Generation RAG Techniques
🐍 CryptoOracle Startup - LLM with Milvus

Apps, Demos, Examples, Models, Notebooks and Projects

🐍 RAG 101
🐦 Milvus Knowledgebase
👻 AIM Ghosts
🔥 Becoming an AI Engineer Series
🐍 Advanced RAG Overview
🎛️ Class #6 - "Deploying Large Language Models"
🐦 x
🦙 Dbta roundtable
📊 Dbta roundtable slides
🚕 Unstructured Data - Ghosts - Part 1

CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/unstructured-data-meetup-new-york/?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

https://forms.gle/96nwiyt9LWGfAXxs5

This is Issue #160

Events

October 23, 2024: Unstructured Data Meetup NYC https://lu.ma/naqu6xrd

October 24, 2024: Startup Grind Princeton AI https://www.startupgrind.com/events/details/startup-grind-princeton-presents-supercharging-startups-with-unstructured-data-vector-databases-and-ai/

October 25, 2024: BITS NYC

October 27 - 29, Raleigh, NC - All Things Open https://2024.allthingsopen.org/speakers/timothy-spann https://2024.allthingsopen.org/sessions/advanced-retrieval-augmented-generation-rag-techniques

October 31 - Live stream from my Halloween decorations with three 12 foot skeletons

November 5-7, 10-12, 2024: CloudX. Online/Santa Clara. https://www.developerweek.com/cloudx/

November 15, 2024: Build Stuff. Online. Adding Generative AI to Real-Time Streaming Pipelines https://www.developerweek.com/cloudx/speakers/

November 19, 2024: XtremePython. Online. https://xtremepython.dev/2024/

November 21, 2024: Big Data Conference 2024 EU 

https://events.pinetool.ai/3254/#sessions/108389?referrer%5Bpathname%5D=%2Fsessions&referrer%5Bsearch%5D=&referrer%5Btitle%5D=Sessions

November 21, 2024: Unstructured Data Meetup NYC https://lu.ma/cqxuproe

December 10, 2024: Unstructured Data Meetup NYC https://lu.ma/u2ijucyv

© 2020-2024 Tim Spann https://www.youtube.com/@FLaNK-Stack