Modern Data Platforms & RAG

Dynamics 365 F&O pipeline to Synapse Link to Apache Iceberg. ACID transactions on the data lake, time travel, schema evolution.

Dremio and Teiid to query heterogeneous sources without moving data. Federated queries across Dynamics, PostgreSQL, and S3 in a single view.

Azure Event Grid and n8n: Dynamics 365 transitions from passive silo to real-time event engine. Instant reaction to create, update, and delete events.

Ingestion, semantic chunking, embedding, Weaviate, retrieval, LLM. Production-ready with deduplication and cursor pagination at scale.

Budibase and Weaviate: administrative interfaces on vector DB with cursor-based pagination on datasets exceeding 10,000 records. No custom code.

Directus as API data hub with Budibase as the UI and automation layer. Application-level triggers versus database triggers for maximum flexibility.