Anomaly Detection and Data Classification with Qdrant Integration
Workflow Description
Advanced automation that ingests datasets from Google Cloud Storage, applies classification algorithms to detect anomalies, and uploads results to Qdrant for vector storage and semantic search. Processes data at scale with configurable filtering and error handling.
How it works
- 1.Load dataset from Google Cloud Storage or manual trigger
- 2.Apply classification algorithm to identify anomalous patterns
- 3.Transform results into vectors and upload to Qdrant database
Use cases
- Detect fraudulent transactions in financial records
- Identify unusual user behavior patterns in application logs
- Analyze large datasets and store vectors for semantic similarity search
Requirements
- Active Google Cloud Storage account with dataset access
- Configured Qdrant instance with vector database setup
- Understanding of classification algorithms and anomaly detection methods
Service Value
Ready-made workflow template for automation delivery and service execution.
Apps Used
Details
How to Use
- 1.Click "Download Template"
- 2.Open your n8n dashboard
- 3.Go to Workflows > Import from File
- 4.Select downloaded file and configure credentials
Nodes Used (25)
When clicking ‘Test workflow’
Manual Trigger
Google Cloud Storage
Google Cloud Storage
Get fields for Qdrant
Set
Qdrant cluster variables
Set
Embed crop image
HTTP Request
Create Qdrant Collection
HTTP Request
Check Qdrant Collection Existence
HTTP Request
Batches in the API's format
Set
Batch Upload to Qdrant
HTTP Request
Split in batches, generate uuids for Qdrant points
Code
If collection exists
If
Sticky Note
Sticky Note
Payload index on crop_name
HTTP Request
Sticky Note1
Sticky Note
Sticky Note2
Sticky Note
Sticky Note3
Sticky Note
Sticky Note4
Sticky Note
Sticky Note5
Sticky Note
Sticky Note6
Sticky Note
Sticky Note7
Sticky Note
Sticky Note9
Sticky Note
Sticky Note11
Sticky Note
Filtering out tomato to test anomalies
Filter
Sticky Note8
Sticky Note
Sticky Note10
Sticky Note