Legacy Content Cleanup with Local AI

Project category

Tasks completed by AI Agents
0 k+

Perform Agent: AI standardizes thousands of documents – without changing a single word

Project Overview

 

Industry: Education Technology
Solution Type: Content Migration & Standardization
Deployment: Local Infrastructure

The Challenge

A growing educational platform had a content problem hiding in plain sight.

Over ten years of operation, their lesson database had grown to over 10,000 entries. But these lessons were created by different people, using different tools, at different times. Some were clean HTML. Others were Word documents pasted into text fields. Many contained inline styles, deprecated tags, and formatting artifacts that caused rendering issues across devices.

The content was valuable. The formatting was chaos.


 

The Solution

We built Perform Agent, a production-grade AI system for bulk content transformation with a critical constraint: zero content alteration.

The Three-Step Pipeline

Step 1: ANALYZE
Before touching any content, the AI classifies each record:

  • LEGACY → Needs transformation (old formatting, inconsistent structure)
  • MODERN → Already meets standards (skip processing, save resources)
  • EMPTY → Placeholder or blank (flag for review)

This intelligent routing saves time and money by only processing what actually needs work.

Step 2: FORMAT
The AI transforms legacy content into standardized, modern structure:

  • Converts deprecated HTML to semantic markup
  • Removes inline styles and formatting artifacts
  • Applies consistent heading hierarchy
  • Standardizes list and table structures

The Critical Constraint: Structure changes only. The AI is explicitly prohibited from altering any actual content—no changing case, no modifying punctuation, no “improving” word choices. What the author wrote is exactly what comes out.

Step 3: VERIFY
After formatting, the AI acts as its own quality inspector:

  • Compares original and formatted versions character-by-character
  • Flags any detected content alterations
  • Returns VERIFIED status or detailed error report
  • Failed records are automatically queued for retry with additional context

 

Production-Grade Features

Batch Processing
Records are processed in configurable batches (5-50 at a time). The system tracks progress across batches and automatically continues to the next batch upon completion.

Parallel Workers
Multiple records are processed simultaneously (1-8 workers). Processing speed scales with available resources.

Real-Time Dashboard
At any moment, see exactly where you stand:

  • Completed count and percentage
  • Pending records remaining
  • Error count with detailed breakdown
  • Skipped records (already modern)

Graceful Stop
Pause processing at any time. Workers finish their current record, save all progress, and wait. Resume whenever you’re ready—the system picks up exactly where it left off.

Smart Retry
When a record fails verification, the retry attempt includes:

  • The previous error message
  • The failed attempt for context
  • Explicit instruction to avoid the same mistake

Each retry is smarter than the last.

Safe by Design
Original content is never modified. Formatted versions are stored separately. Full rollback capability at any time.


 

Results

Metric Manual Approach With Perform Agent
Timeline 3-6 months 3 weeks
Labor cost $45,000+ Minimal oversight
Consistency Variable 100% uniform
Content integrity Risk of alterations Verified unchanged
Progress visibility Manual tracking Real-time dashboard

The client completed their entire content migration in under a month. The transformation was consistent across all 10,000 lessons, and the verification step confirmed that zero content alterations occurred.


 

Technical Approach

  • Three-stage AI pipeline with built-in verification
  • Queue-based processing with PostgreSQL backend
  • Thread-safe parallel execution for performance
  • Local LLM deployment for privacy and unlimited processing
  • Streamlit interface for monitoring and control

 

Content Types We Handle

Perform Agent can transform any text-based content at scale:

  • Educational content (lessons, courses, assessments)
  • Product descriptions (e-commerce catalogs)
  • Documentation (technical docs, help centers)
  • Legal documents (contracts, policies)
  • Medical records (clinical notes, reports)
  • Marketing content (blog posts, landing pages)

If you have thousands of records in inconsistent formats, the approach applies.


 

The Difference: Demo vs. Production

Most AI demos show one document being reformatted. Impressive for five minutes. Useless at scale.

Perform Agent was built for the real world:

Demo AI Perform Agent
Handles one document Handles thousands
No error handling Automatic detection and retry
No progress tracking Real-time dashboard
Hope nothing breaks Graceful pause and resume
Cross your fingers Verification on every record
Content might change Zero alteration guarantee

 

Is This Right For You?

Perform Agent is built for organizations with bulk content to modernize:

  • EdTech platforms standardizing years of accumulated lessons
  • Publishers updating legacy document formats
  • E-commerce companies normalizing product descriptions
  • Enterprises migrating content between systems
  • Any organization with inconsistent formatting across thousands of records

If manual reformatting feels impossible and you can’t risk changing your actual content, let’s talk.


Ready to transform your content at scale? Book a consultation to discuss your specific situation.