Create AI-ready vector datasets for LLM students using Gemini and Pinecone
Workflow Description
A workflow that prepares AI-ready vector datasets for students by splitting documents, generating embeddings with Gemini, and storing them in Pinecone for semantic search, with optional X sharing for community engagement.
How it works
- 1.Trigger manually and load documents using the Document Data Loader
- 2.Split text into overlapping chunks with the Recursive Character Text Splitter
- 3.Generate embeddings via Google Gemini and store vectors in Pinecone
- 4.Extract structured information using LLM Chain with output parsing
- 5.Publish results to X for community sharing and feedback
Use cases
- Building curated training datasets for machine learning and LLM courses
- Creating searchable knowledge bases for student research and learning projects
Requirements
- Google Gemini API key with embeddings capability
- Pinecone account with an active vector index configured
- X API credentials for automated posting
Service Value
Ideal as a smart automation service combining integrations and AI to produce ready-to-use results.
Apps Used
Details
How to Use
- 1.Click "Download Template"
- 2.Open your n8n dashboard
- 3.Go to Workflows > Import from File
- 4.Select downloaded file and configure credentials
Nodes Used (21)
When clicking ‘Test workflow’
Manual Trigger
AI Agent
Agent
Pinecone Vector Store
Vector Store Pinecone
Embeddings Google Gemini
Gemini Model
Default Data Loader
Document Default Data Loader
Recursive Character Text Splitter
Text Splitter Recursive Character Text Splitter
Google Gemini Chat Model1
Gemini Model
Google Gemini Chat Model2
Gemini Model
Google Gemini Chat Model
Gemini Model
Structured Output Parser
Output Parser Structured
Sticky Note
Sticky Note
Set Fields - URL and Webhook URL
Set
Make a web request
HTTP Request
Structured JSON Data Formatter
LLM Chain
Webhook for structured data
HTTP Request
Webhook for structured AI agent response
HTTP Request
Sticky Note1
Sticky Note
Sticky Note2
Sticky Note
Sticky Note3
Sticky Note
Information Extractor with Data Formatter
Information Extractor
Sticky Note4
Sticky Note