Amazon S3 Vectors adds metadata pre-filtering capability

Amazon has introduced metadata pre-filtering for S3 Vectors, allowing users to filter attributes, such as category or status, before running a similarity search. This approach increases the number of relevant results for queries limited by specific metadata. Filters can now use prefix matching for fields like paths and URLs. The update requires no additional cost or data re-ingestion, and aims to improve recall in filtered semantic searches and retrieval-augmented generation applications.

• Pre-filtering evaluates metadata before similarity search
• Supports prefix matching for paths and hierarchical keys
• No extra cost or need to re-ingest data
• Up to 2 KB metadata per vector, 100 filters per query
• Improves recall in filtered vector search scenarios