3 posts tagged with "autobench"

We are excited to release a new RAG benchmark for finance applications. This dataset contains queries and responses to evaluate AI chatbots and RAG applications for hallucinations and accuracy. The dataset was created using Lighthouz AutoBench, a no-code test case generator for LLM use cases, and then manually verified by two human annotators.

The dataset is available on HuggingFace at: https://huggingface.co/datasets/lighthouzai/rag-benchmark-finance-apple-10K-2022.

The dataset is also preloaded on all Lighthouz accounts.

Come join our upcoming webinar on the transformative power of Retrieval Augmented Generation (RAG)!

This innovative approach combines the vast knowledge of large language models with the precision of information retrieval, setting a new standard for generating accurate and contextually rich text. As RAG technology continues to evolve, understanding how to build and evaluate RAG applications becomes crucial for anyone looking to stay ahead in the field of AI. This session will not only cover the basics of RAG but also delve into the practical aspects of choosing information sources, designing retrieval strategies, and integrating these components for optimal performance. Expect a live demo and a code-share session that will give you hands-on experience on how to build and subsequently evaluate RAG technologies.

Learn how to Build Secure RAG apps in 30 mins with LlamaIndex + Lighthouz AI + Meta Llama Guard

RAG apps are all the rage in Generative AI, but how do you build secure apps that can be reliably put in production?