Yellowstone with Milvus

Yellowstone Pools

AIM Weekly for 29 July 2024

 https://zilliz.com/event/unstructured-data-processing-from-cloud-to-edge

29-July-2024

Tim Spann @PaaSDev Milvus - Towhee - Attu - Feder - GPTCache - VectorDB Bench

AIM Weekly (Towhee - Attu - Milvus (Tim-Tam))

https://github.com/milvus-io/milvus?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

https://www.youtube.com/@FLaNK-Stack

https://medium.com/@tspann/subscribe

https://ossinsight.io/analyze/tspannhw

CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/unstructured-data-meetup-new-york/?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

This is Issue #148

Join us at the next meetup.

August 13, 2024 5:30 to 8:30 PM in NYC @ New York https://www.meetup.com/unstructured-data-meetup-new-york/

I am very sorry for the venue issues, we will fix this.

We had some issues with Cloudera's facility and couldn't get in. We had an impromptu short meeting and a recorded my talk you can check out.

https://medium.com/@tspann/report-exciting-meetup-on-july-25-2024-6df5c3a97373

https://www.youtube.com/watch?v=AuWveijqcog

Edge News

I may have some really cool edge stuff coming for August, looks like we may have some next gen Edge LLM RAG going on.

Articles

There's a lot of cool stuff with Milvus and new models, techniques, libraries and use cases.

https://medium.com/@zilliz_learn/improving-information-retrieval-and-rag-with-hypothetical-document-embeddings-hyde-db39021d7688

BM25 https://medium.com/@tspann/ranking-for-relevance-with-bm25-b2d9dd62e2f8

https://medium.com/@mat.martial/how-to-make-your-rag-less-distracted-5d79a1381841

https://news.mit.edu/2024/creating-verifying-stable-ai-controlled-systems-rigorous-flexible-way-0717

https://mychen76.medium.com/deep-dive-loading-unstructured-text-into-a-knowledge-graph-using-large-language-models-llms-bfc013f7dc17

https://towardsdatascience.com/running-local-llms-is-more-useful-and-easier-than-you-think-f735631272ad

https://llama.meta.com/

What is RAG? https://zilliz.com/learn/Retrieval-Augmented-Generation

https://0xinfection.github.io/reversing/

https://aml4td.org/

https://www.globalxetfs.com/internet-of-things-and-devices-poised-for-edge-ai-driven-upgrades/

https://medium.com/enterprise-rag/whyhow-ai-kg-studio-platform-beta-rag-native-graphs-1105e5a84ff2

https://www.youtube.com/watch?v=5XOSHpKGWYU

Videos

NYC Replacement Talk https://www.youtube.com/watch?v=AuWveijqcog

Live Fun Friday with Unstructed Data Preview https://www.youtube.com/watch?v=_jQB62uPsvc

Running the NVIDIA Milvus Lite Demo https://www.youtube.com/watch?v=7kdYbaw2LSQ

Hands on Demo https://www.youtube.com/watch?v=6zgdTCyx3Zg

South Bay Meetup https://www.youtube.com/watch?v=MDHyrhrulWo

NYC Preview https://www.youtube.com/watch?v=5XOSHpKGWYU

Hands On https://www.youtube.com/watch?v=6zgdTCyx3Zg

Slides

https://www.slideshare.net/slideshow/nycmeetup07-25-2024-unstructured-data-processing-from-cloud-to-edge/270502823

https://www.slideshare.net/slideshow/06-20-2024-ai-camp-meetup-unstructured-data-and-vector-databases/269789268

https://www.slideshare.net/slideshow/multimodal-embeddings-continued-south-bay-meetup-slides/270479192

Releases

https://github.com/huggingface/transformers/releases/tag/v4.42.0

Events

Oct 27 - 29, Raleigh, NC - All Things Open https://2024.allthingsopen.org/speakers/timothy-spann

Nov 5-7, 10-12, 2024: CloudX. Online/Santa Clara. https://www.developerweek.com/cloudx/

Nov 19, 2024: XtremePython. Online. https://xtremepython.dev/2024/

Webinars

Join me at my first Milvus Webinar!!!!!! 

Thursday, August 1 9:00 AM Pacific | 12:00 PM Eastern 45-minute presentation | 15-minute Q&A https://zilliz.com/event/unstructured-data-processing-from-cloud-to-edge

Code

• https://github.com/tspannhw/AIM-MilvusLite
• https://github.com/tspannhw/AIM-NYCStreetCams
• https://github.com/tspannhw/AIM-MotorVehicleCollisions
• https://github.com/milvus-io/milvus?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

Models

• https://huggingface.co/docs/transformers/en/model_doc/owlv2
• https://huggingface.co/docs/transformers/model_doc/clipseg
• https://huggingface.co/microsoft/Florence-2-large
• https://mistral.ai/news/mistral-large-2407/
• https://github.com/fixie-ai/ultravox

Tools

• https://ai.meta.com/research/publications/the-llama-3-herd-of-models/
• https://satyrn.app/
• https://github.com/Netflix/maestro
• https://github.com/garyexplains/examples/blob/master/how-to-run-llama-cpp-on-raspberry-pi.md
• https://github.com/iterative/datachain
• https://mistral.ai/news/mistral-nemo/
• https://github.com/mlfoundations/MINT-1T
• https://trufflesecurity.com/blog/anyone-can-access-deleted-and-private-repo-data-github
• https://github.com/ElliotKillick/rss2newsletter
• https://listmonk.app/#download
• https://github.com/DropbaseHQ/dropbase
• https://github.com/camel-ai/camel
• https://dev.to/latitude/the-ultimate-llm-leaderboard-ranking-the-best-language-models-2a67
• https://github.com/KwaiVGI/LivePortrait
• https://beacondb.net/
• https://github.com/ollama/ollama-python
• https://github.com/bentoml/OpenLLM
• https://github.com/LyzrCore/lyzr-automata
• https://github.com/google-deepmind/treescope
• https://haystackeditor.com/
• https://github.com/milvus-io/milvus-sdk-csharp/blob/main/docs/readme.md
• https://github.com/openvinotoolkit/openvino_notebooks/tree/recipes/recipes
• https://github.com/google-research/neuralgcm
• https://github.com/features/issues
• https://github.com/igrek51/wat
• https://github.com/mriale/PyDPainter
• https://github.com/llmware-ai/llmware
• https://brev.dev/
• https://github.com/vye16/shape-of-motion
• https://github.com/brevdev/notebooks/blob/main/llama31_law.ipynb
• https://jellyfin.org/
• https://github.com/sgl-project/sglang
• https://github.com/vye16/shape-of-motion

© 2020-2024 Tim Spann https://www.youtube.com/@FLaNK-Stack

🖥️ Videos:  [https://www.youtube.com/@MilvusVectorDatabase/videos](https://www.youtube.com/@MilvusVectorDatabase/videos)
X Twitter -   / milvusio  [https://x.com/milvusio](https://x.com/milvusio)
🔗 Linkedin:  / zilliz  [https://www.linkedin.com/company/zilliz/](https://www.linkedin.com/company/zilliz/)
😺 GitHub: [https://github.com/milvus-io/milvus](https://github.com/milvus-io/milvus)
🦾 Invitation to join discord:   / discord  [https://discord.com/invite/FjCMmaJng6](https://discord.com/invite/FjCMmaJng6)




Unstructured Data Processing with a Raspberry Pi AI Kit - Hailo Edge AI ...

Unstructured Data Processing Meetup NYC - 25 July 2024 -

South Bay Unstructured Data Meetup July 23 2024

AIM Weekly for 22 July 2024

 

22-July-2024

Tim Spann @PaaSDev Milvus - Towhee - Attu - Feder - GPTCache - VectorDB Bench

AIM Weekly (Towhee - Attu - Milvus (Tim-Tam))

https://github.com/milvus-io/milvus?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

https://www.youtube.com/@FLaNK-Stack

https://medium.com/@tspann/subscribe

https://ossinsight.io/analyze/tspannhw

CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual.

https://www.meetup.com/unstructured-data-meetup-new-york/?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

This is Issue #147

Join me:

July 25, 2024 5:30 to 8:30 PM in NYC @ Cloudera 101 5th Ave · New York, NY Cloudera office - 8th Floor https://www.meetup.com/unstructured-data-meetup-new-york/events/301720478/?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external

Edge News

I may have some really cool edge stuff coming for August, looks like we may have some next gen Edge LLM RAG going on.

Articles

There's a lot of cool stuff with Milvus and new models, techniques, libraries and use cases.

BM25 https://medium.com/@tspann/ranking-for-relevance-with-bm25-b2d9dd62e2f8

Edge AI with Milvus Lite https://medium.com/@tspann/edgeai-edge-vector-database-6a9b5238bffb

Quantization!?!?!? https://medium.com/@tspann/how-good-is-quantization-in-milvus-6d224b5160b0

MULTI-SPECTRAL REMOTE SENSING IMAGE RETRIEVAL USING GEOSPATIAL FOUNDATION MODELS https://arxiv.org/html/2403.02059v1

Generative AI Develop LLM Powered Apps with LangChain, Python and Milvus https://rajatnigam89.medium.com/generative-ai-develop-llm-powered-applications-with-langchain-python-and-milvus-vectordb-5b796c0c05e3

Milvus with ML https://www.msn.com/en-gb/money/technology/vijay-bhaskar-kamireddy-revolutionizing-machine-learning-with-innovation-and-expertise/ar-BB1p6ENP

The 2024 Playbook Top Use Cases for Vector Search https://medium.com/@zilliz_learn/the-2024-playbook-top-use-cases-for-vector-search-2d61b4e6db81

PDF Parsing with LMM https://ai.gopubby.com/demystifying-pdf-parsing-04-ocr-free-large-multimodal-model-based-method-0fdab50db048

Diff PDF https://github.com/vslavik/diff-pdf

Why has Autonomous Driving Failed? https://artificio.org/blog/why-has-autonomous-driving-failed-perspectives-from-peru-and-insights-from-neuroai

Voxel 51 https://voxel51.com/try-fiftyone/

PyMilvus Integrations with Embedding Models https://milvus.io/blog/introducing-pymilvus-integrations-with-embedding-models.md

Changes of Embeddings During Fine Tuning https://itnext.io/changes-of-embeddings-during-fine-tuning-c22aa1615921

Awesome Lists

https://github.com/huggingface/transformers/blob/main/awesome-transformers.md

What is RAG? https://zilliz.com/learn/Retrieval-Augmented-Generation

Videos

Live Fun Friday with Unstructed Data Preview https://www.youtube.com/watch?v=_jQB62uPsvc

Running the NVIDIA Milvus Lite Demo https://www.youtube.com/watch?v=7kdYbaw2LSQ

Slides

https://www.slideshare.net/slideshow/06-20-2024-ai-camp-meetup-unstructured-data-and-vector-databases/269789268

https://www.slideshare.net/slideshow/06-18-2024-princeton-meetup-introduction-to-milvus/269765983

https://www.slideshare.net/slideshow/06-12-2024-budapestdataforum-buildingreal-timepipelineswithflank-aim/269645846

Releases

https://github.com/huggingface/transformers/releases/tag/v4.42.0

Events

Oct 27 - 29, Raleigh, NC - All Things Open https://2024.allthingsopen.org/speakers/timothy-spann

Nov 5-7, 10-12, 2024: CloudX. Online/Santa Clara. https://www.developerweek.com/cloudx/

Nov 19, 2024: XtremePython. Online. https://xtremepython.dev/2024/

Webinars

Building an Agentic RAG locally with Milvus, Ollama and LangGraph July 11, 2024 | 9:00 AM PT/12:00PM ET | Stephen Batifol, Zilliz Get hands-on and learn how to:

• Enable agent planning, memory, and tool use for tasks
• Allow LLM web searches and custom function calls
• Implement fallbacks and self-correction for agent errors https://zilliz.com/event/rag-agents-with-langchain-and-milvus?utm_campaign=tim

RAG Evaluation with Ragas July 18 | 9:00 AM PT/12:00PM ET | Christy Bergman, Zilliz

• Evaluate a RAG pipeline using metrics like context F1-score and answer correctness, then learn the differences between:
• Foundation model evaluation vs RAG evaluation
• Human evaluation vs LLM-as-a-judge evaluations
• Overall RAG vs RAG component evaluations https://zilliz.com/event/rag-evaluation-with-ragas?utm_campaign=tim

Hands-On Demo: Building and Scaling Vector Search Apps with Zilliz Cloud July 25, 2023 | 9:00 AM PT/12:00PM ET | Frank Liu, Zilliz Learn how to build and scale vector search applications with live examples. Walk through the following:

• Live Zilliz Cloud setup and configuration
• Building a simple chatbot step-by-step
• Advanced search techniques with examples https://zilliz.com/event/hands-on-zilliz-cloud-demo?utm_campaign=tim

Join me at my first Milvus Webinar!!!!!! 

Thursday, August 1 9:00 AM Pacific | 12:00 PM Eastern 45-minute presentation | 15-minute Q&A https://zilliz.com/event/unstructured-data-processing-from-cloud-to-edge

Code

• https://github.com/tspannhw/AIM-MilvusLite
• https://github.com/tspannhw/AIM-NYCStreetCams
• https://github.com/tspannhw/AIM-MotorVehicleCollisions
• https://github.com/milvus-io/milvus?utm_source=partner&utm_medium=referral&utm_campaign=2024_newsletter_tspann-ai-newsletters_external
• https://docs.voxel51.com/integrations/milvus.html
• https://www.stuartellis.name/articles/python-modern-practices/
• https://github.com/adithya-s-k/omniparse
• https://github.com/VikParuchuri/surya
• https://huggingface.co/docs/transformers/main/chat_templating
• https://huggingface.co/spaces/chandrakalagowda/reverseimagepolitical/blob/main/2_deepdiveimagesearch.py
• https://github.com/VikParuchuri/texify

Models

• https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2
• https://huggingface.co/dbmdz/electra-large-discriminator-finetuned-conll03-english
• https://huggingface.co/google/vit-base-patch16-224
• https://huggingface.co/facebook/detr-resnet-50
• https://huggingface.co/openai/whisper-large-v3
• https://huggingface.co/superb/wav2vec2-base-superb-ks
• https://huggingface.co/google/siglip-so400m-patch14-384
• https://huggingface.co/docs/transformers/model_doc/xclip
• https://huggingface.co/docs/transformers/en/model_doc/owlv2
• https://huggingface.co/docs/transformers/model_doc/clipseg
• https://huggingface.co/microsoft/Florence-2-large

Tools

• https://github.com/pretzelai/pretzelai/blob/main/README.md
• https://rapids.ai/cuvs/
• https://github.com/vshymanskyy/ViperIDE
• https://pikimov.com/
• https://github.com/interpretml/interpret
• https://github.com/ComposioHQ/composio
• https://github.com/onuratakan/gpt-computer-assistant?tab=readme-ov-file
• https://undraw.co/
• https://github.com/yhydhx/SAMAug

© 2020-2024 Tim Spann https://www.youtube.com/@FLaNK-Stack

🖥️ Videos:  [https://www.youtube.com/@MilvusVectorDatabase/videos](https://www.youtube.com/@MilvusVectorDatabase/videos)
X Twitter -   / milvusio  [https://x.com/milvusio](https://x.com/milvusio)
🔗 Linkedin:  / zilliz  [https://www.linkedin.com/company/zilliz/](https://www.linkedin.com/company/zilliz/)
😺 GitHub: [https://github.com/milvus-io/milvus](https://github.com/milvus-io/milvus)
🦾 Invitation to join discord:   / discord  [https://discord.com/invite/FjCMmaJng6](https://discord.com/invite/FjCMmaJng6)