System Overview

Architecture Overview

Trendteller is built as a comprehensive multi-part system that aggregates e-commerce data from multiple platforms, transforms it through a data pipeline, and provides insights through a modern web interface and AI-powered analytics.

System Components

Platform Frontend

Nuxt 3 dashboard for analytics and insights

Data Pipeline

Dataform transformations on BigQuery

Data Connectors

Airbyte integrations for 9 e-commerce platforms

AI Workflows

Kestra scripts for insights and forecasting

Data Flow Diagram

┌─────────────────────────────────────────────────────────────────┐
│                     E-Commerce Platforms                        │
│  (Bling, VNDA, Shoppub, Tiny, Microvix, Braavo, JetERP, etc.) │
└────────────────┬────────────────────────────────────────────────┘
                 │
                 ▼
┌─────────────────────────────────────────────────────────────────┐
│              Airbyte (Custom Connectors)                        │
│          15 Sources + 2 Destinations (TypeScript)               │
└────────────────┬────────────────────────────────────────────────┘
                 │
                 ▼
┌─────────────────────────────────────────────────────────────────┐
│                 BigQuery Data Lake                              │
│                  (Bronze Layer - Raw Data)                      │
└────────────────┬────────────────────────────────────────────────┘
                 │
                 ▼
┌─────────────────────────────────────────────────────────────────┐
│                    Dataform Transformations                     │
│    Bronze → Silver (Standardized) → Gold (Analytics-Ready)     │
└────────────────┬────────────────────────────────────────────────┘
                 │
                 ▼
┌─────────────────────────────────────────────────────────────────┐
│                         Hasura V2                               │
│       GraphQL API Engine (Postgres/NeonDB + BigQuery)          │
└────────────────┬────────────────────────────────────────────────┘
                 │
                 ▼
┌─────────────────────────────────────────────────────────────────┐
│                  Platform Front (Nuxt 3)                        │
│          Analytics Dashboard + Forecasting UI                   │
│                    (Auth0 + Netlify)                            │
└─────────────────────────────────────────────────────────────────┘

              ┌──────────────────────┐
              │  Kestra Scripts      │
              │  (AI Insights,       │
              │   Forecasting,       │
              │   Web Crawling)      │
              └──────────────────────┘

Data Flow Process

Data Ingestion

Airbyte connectors extract data from 9 e-commerce platforms (11 brands) including Bling, VNDA, Shoppub, Tiny, Microvix, and others.

Raw Storage

Raw data lands in BigQuery’s Bronze layer, maintaining source format and structure for full traceability.

Data Transformation

Dataform processes data through Silver (standardized) and Gold (analytics-ready) layers using SQLX templates.

API Exposure

Hasura V2 exposes transformed data via a type-safe GraphQL API, combining BigQuery analytics data with Postgres operational data.

Data Consumption

Frontend dashboard displays analytics and visualizations. AI scripts generate insights, forecasts, and automated reports.

Technology Stack

Frontend Stack

Framework: Nuxt 3 (v3.16.2) with TypeScript
UI Library: Vuetify 3 component library
State Management: Pinia with persistence
Authentication: Auth0
API Client: GraphQL with Genql (type-safe)
Hosting: Netlify

Data Stack

Data Warehouse: Google BigQuery
Transformation: Dataform Core 3.0.0
Integration: Airbyte CDK (TypeScript)
Orchestration: Kestra workflows
API Layer: Hasura V2 GraphQL Engine

AI & Analytics

AI Providers: OpenAI, Google Gemini AI
Automation: Puppeteer for web crawling
Database: PostgreSQL (NeonDB) for operational data

Infrastructure

Cloud Services
Authentication & Hosting
Development & CI/CD

Google Cloud Platform: BigQuery data warehouse
AWS: Additional cloud services
Neon: Managed PostgreSQL database

Key Features

Multi-Brand Support

Consolidates data from 11 brands across 9 e-commerce platforms into unified analytics

Real-time GraphQL API

Type-safe API powered by Hasura V2 with automatic schema generation

AI-Powered Insights

Leverages OpenAI and Gemini AI for forecasting and trend analysis

Scalable Data Pipeline

Medallion architecture on BigQuery ensures data quality and performance

Scale & Metrics

Brands: 11 supported brands
Integrations: 9 e-commerce platforms
Connectors: 15 source + 2 destination connectors
Frontend Pages: 23 pages
UI Components: 29 reusable components
Data Tables: 20+ analytics tables

Next Steps

Key Concepts

Learn about medallion architecture and multi-brand analytics

API Reference

Explore the Trendteller API

Architecture Deep Dive

Explore detailed system architecture

API Reference

Integrate with Trendteller’s GraphQL API

Getting Started

Components

User Guides

Architecture Overview

System Components

Platform Frontend

Data Pipeline

Data Connectors

AI Workflows

Data Flow Diagram

Data Flow Process

Technology Stack

Frontend Stack

Data Stack

AI & Analytics

Infrastructure

Key Features

Multi-Brand Support

Real-time GraphQL API

AI-Powered Insights

Scalable Data Pipeline

Scale & Metrics

Next Steps

Key Concepts

API Reference

Architecture Deep Dive

API Reference

​Architecture Overview

​System Components

Platform Frontend

Data Pipeline

Data Connectors

AI Workflows

​Data Flow Diagram

​Data Flow Process

​Technology Stack

​Frontend Stack

​Data Stack

​AI & Analytics

​Infrastructure

​Key Features

Multi-Brand Support

Real-time GraphQL API

AI-Powered Insights

Scalable Data Pipeline

​Scale & Metrics

​Next Steps

Key Concepts

API Reference

Architecture Deep Dive

API Reference

Architecture Overview

System Components

Data Flow Diagram

Data Flow Process

Technology Stack

Frontend Stack

Data Stack

AI & Analytics

Infrastructure

Key Features

Scale & Metrics

Next Steps