Quave ONE Logo

Migrating Large-Scale Commerce Analytics from Azure to Oracle OCI with MySQL HeatWave

"Quave led the initiative end to end, owning the migration strategy, architecture design, and production readiness. The platform was redesigned around Oracle OCI and MySQL HeatWave, enabling fast aggregations over very large datasets and near real-time analytics that were not viable on the legacy architecture."
Neotrust Representative

Neotrust TeamConfi Group

Overview

Neotrust is a Brazilian commerce intelligence company, part of the Confi Group, responsible for capturing, processing, and analyzing more than 2 million e-commerce transactions per day across Brazil.

The platform handles data at significant scale, including approximately 5 TB of raw transaction data and over 10 TB of enriched data, combining external sources, business logic, and machine learning models.

Neotrust delivers analytics to large retailers, global brands operating in Brazil, and financial institutions, providing visibility into market dynamics, product trends, and consumer behavior at national scale.

To enable near real-time analytics and support business growth, Neotrust migrated its data platform from Microsoft Azure to Oracle Cloud Infrastructure (OCI), adopting Oracle MySQL HeatWave as its core analytics engine.

Quave acted as the technical and operational lead, responsible for the architecture, migration, and production readiness of the new platform.

The Business Challenge

Neotrust ingests raw transaction data from Brazilian e-commerce platforms that is highly unstructured, often containing only free-text product titles, without SKU or barcode information.

This raw data is continuously enriched with external datasets, business rules, and machine learning models, resulting in multi-terabyte analytical datasets.

From this limited and noisy input, the platform must identify products, classify them using machine learning, aggregate transactions into meaningful categories, and deliver analytics that are reliable, timely, and usable by enterprise customers, including during critical events such as Black Friday.

This requires continuous processing, high scalability, and low-latency analytics over very large datasets at national scale.

Infrastructure Challenges Before the Migration

Before the migration, Neotrust faced several constraints:

  • Legacy SQL Server workloads running on Azure
  • Data distributed across multiple databases and pipelines
  • High operational overhead and recurring instability
  • Severe difficulty operating during peak events such as Black Friday

As a result, customer delivery relied mostly on periodic CSV exports, limiting the company's ability to offer live or near real-time analytics over large volumes of data.

Project Objectives

The project focused on two tightly connected objectives.

1. Modernize the analytics platform on Oracle OCI

  • Migrate SQL Server workloads from Azure to OCI
  • Improve stability, scalability, and predictability
  • Reduce operational complexity and costs

2. Enable near real-time analytics at scale with MySQL HeatWave

  • Support low-latency analytics over multi-terabyte datasets
  • Power complex aggregations across enriched transaction data
  • Make near live analytics technically and economically viable
  • Operate reliably during extreme peak events such as Black Friday
The Solution: Oracle OCI and MySQL HeatWave

Quave led the initiative end to end, owning the migration strategy, architecture design, and production readiness.

The platform was redesigned around Oracle OCI and MySQL HeatWave. MySQL HeatWave acted as the core engine that enabled fast aggregations over very large datasets, simplified data pipelines, and near real-time analytics that were not viable on the legacy architecture.

Architecture Highlights

MySQL HeatWave-Centered Analytics Architecture

  • Raw transaction data stored as Parquet files in OCI Object Storage
  • Enriched datasets reaching over 10 TB queried directly by MySQL HeatWave
  • Unified SQL access to file-based and structured data
  • In-memory analytics enabling fast aggregations across large portions of the dataset

Business queries executed on MySQL HeatWave regularly operate over substantial slices of this enriched data, using query strategies and partitioning to deliver performance while keeping the full dataset continuously available for analysis.

This architecture allowed Neotrust to move from batch-oriented processing to near live analytics, even when dealing with multi-terabyte analytical workloads.

Operational Simplicity and Platform Continuity

A key design goal was ensuring that the platform could be operated and evolved by the Neotrust team independently after the project.

To achieve this, Quave implemented the Quave ONE™ platform, running entirely within Neotrust's own Oracle Cloud Infrastructure account. This enabled:

  • Simplified day-to-day cloud operations on OCI
  • Short learning curve for teams without prior deep OCI experience
  • Consistent deployment, observability, and governance
  • Reduced long-term dependency on external teams

This approach ensured long-term maintainability, autonomy, and continuity of the platform.

Business Impact

Performance and Scalability

  • Black Friday 2024 was unstable and operationally stressful
  • Black Friday 2025 ran predictably, with near live analytics available during the event

Key outcomes included hourly analytics delivered with approximately 15 minutes of delay and technical capacity to reduce latency further if required, even when processing large volumes of enriched data.

Black Friday shifted from being a major risk to a controlled and predictable operation.

Go-to-Market Impact

The new near real-time analytics platform replaced periodic CSV exports with a live data experience for customers.

The platform was publicly launched at Mercado Livre Experience 2025, enabling retailers, banks, and global brands operating in Brazil to monitor product launches and market trends in near real time, including during Black Friday.

Savings and Economic Impact

The migration resulted in approximately 50% direct infrastructure cost reduction compared to the previous environment.

More importantly, the move to Oracle OCI with MySQL HeatWave changed the team's understanding of what was technically and economically possible. Before the migration, Neotrust relied on periodic CSV exports and believed that near real-time analytics over multi-terabyte datasets would be either prohibitively expensive or technically unfeasible on the legacy architecture.

With OCI and MySQL HeatWave, the company transitioned from batch-based delivery to a near live analytics platform operating continuously over large volumes of enriched data, including during Black Friday. Implementing similar capabilities on the previous stack would have required significantly higher costs and was not considered a realistic option at the time.

Key Savings Drivers

  • Infrastructure consolidation on Oracle OCI
  • More efficient licensing models based on CPU cores and threads
  • Elimination of legacy bottlenecks requiring over-provisioning
  • MySQL HeatWave's in-memory analytics efficiency at scale

In addition, Neotrust secured long-term OCI pricing with fixed USD rates, reducing exposure to exchange rate volatility, which is a critical factor for a Brazil-based company.

Conclusion

By migrating to Oracle OCI and adopting MySQL HeatWave, with Quave leading the entire initiative, Neotrust transformed a legacy, batch-oriented analytics environment into a modern, near real-time data platform operating at national scale.

The project involved migrating and operating an analytics stack handling multiple terabytes of data, including approximately 5 TB of raw transaction data and more than 10 TB of enriched analytical datasets. This migration demonstrated Quave's ability to execute robust, large-scale OCI migrations and deliver production-grade MySQL HeatWave architectures capable of supporting high-volume, mission-critical analytics workloads.

The result was a stable, scalable platform that replaced periodic CSV delivery with live analytics, reduced infrastructure costs, and operated reliably during peak events such as Black Friday.

Technologies

Oracle OCI · MySQL HeatWave · OCI Object Storage · SQL Analytics · Machine Learning Pipelines · Meteor.js · React · Tailwind · Quave ONE™