# DataOps Platform Codebase Cleanup Implementation Plan

> **For agentic workers:** REQUIRED SUB-SKILL: Use superpowers:subagent-driven-development (recommended) or superpowers:executing-plans to implement this plan task-by-task. Steps use checkbox (`- [x]`) syntax for tracking.

**Goal:** Remove confirmed historical frontend/backend code while preserving n8n, DataFlow definition and lineage, data-security entry, governance knowledge-base entry, workbench, HOPMS tooling, and active governance/service/review flows.

**Architecture:** Treat `frontend/src/router/routes.js` and Flask Blueprint registration as reachability sources. Protect retained capabilities with a dependency-free cleanup contract test, remove legacy code in batches, make `app/` the backend source of truth, and verify with static contracts, Python tests, frontend dependency installation, and a production build.

**Tech Stack:** Vue 2, Vue Router 3, Vuex, Flask, Python unittest/pytest, Node.js 24 LTS target with Node.js 22 LTS compatibility fallback, npm.

---

### Task 1: Establish Recovery and Cleanup Contracts

**Files:**
- Backup: `/Users/maxiaolong/Documents/Codex/2026-07-06/g-i/DataOps-platform-backup-before-cleanup-20260716-170321.tar.gz`
- Create: `tests/test_cleanup_contract.py`

- [x] Verify the backup contains `.git`, `app/`, `frontend/`, `database/`, and the analysis report; record its SHA-256.
- [x] Add dependency-free unittest assertions that retained routes/files exist and confirmed legacy paths/routes/API strings do not exist.
- [x] Run `python3 -m unittest tests.test_cleanup_contract -v` and confirm RED failures identify the current legacy code.

### Task 2: Prune Frontend Routes and Historical Pages

**Files:**
- Modify: `frontend/src/router/routes.js`
- Modify: `frontend/src/router/defaultRoute.js`
- Delete: `frontend/src/views/dataChart/`
- Delete: `frontend/src/views/modelSystem/`
- Delete: `frontend/src/views/dataAsset/`
- Delete: `frontend/src/views/dataDiagram/`
- Delete: `frontend/src/views/questionnaireInquiry/`
- Delete: `frontend/src/views/knowledgeBaseResume/`
- Delete: `frontend/src/views/dataGovernance/dataResource/`
- Delete: `frontend/src/views/dataGovernance/dataModules/`
- Delete: `frontend/src/views/dataGovernance/dataIndicator/`
- Delete: `frontend/src/views/dataBook/dataResource/`
- Delete: `frontend/src/views/dataBook/dataModel/`
- Delete: `frontend/src/views/dataBook/indicator/`
- Delete: old non-n8n directories under `frontend/src/views/dataFactory/`
- Delete: old data-origin pages after confirming `dataGovernance/dataSource` has no component dependency on them
- Delete: old system-management pages while retaining `frontend/src/views/systemManage/error/404.vue`

- [x] Remove active and commented legacy route blocks; restore the Data Security route as a visible placeholder.
- [x] Keep `/home`, `/knowledge-base-product` as the future governance knowledge-base entry, active governance/data-book pages, n8n production-line link, `/dataFactory/workflow`, data service, and data review.
- [x] Remove `/update` from base routes and retain only the generic 404 component from system management.
- [x] Scan retained components for imports of deleted views.

### Task 3: Slim Frontend API and Shared Components

**Files:**
- Replace: `frontend/src/api/dataFactory.js` with the ten n8n adapter calls only
- Modify: `frontend/src/api/dataGovernance.js`
- Modify: `frontend/src/api/dataOrigin.js`
- Modify: retained shared data-book components that default to removed resource/model APIs
- Delete: `frontend/src/api/dataChart.js`
- Delete: `frontend/src/api/chartCustomized.js`
- Delete: `frontend/src/api/report.js`
- Delete: `frontend/src/api/productionLine.js`
- Delete: obsolete API modules used only by removed system-management pages

- [x] Remove Data Resource, Data Model, Data Indicator, Vanna training, and DataFlow execute/status/log client functions.
- [x] Keep DataFlow list/detail/CRUD, business-domain list, and script retrieval.
- [x] Remove business-card API functions while preserving `/datasource/*` functions.
- [x] Make shared graph/info components require explicit APIs or use retained metadata/business-domain APIs.
- [x] Scan all retained Vue/JS files for imports of deleted API exports.

### Task 4: Remove Backend DataFlow Runtime and Obsolete Subsystems

**Files:**
- Modify: `app/api/data_flow/routes.py`
- Modify: `app/core/data_flow/dataflows.py`
- Mirror generated deployment output only after `app/` is correct
- Delete: `mcp-servers/task-manager/`

- [x] Remove `/execute-dataflow/{id}`, `/get-dataflow-status/{id}`, and `/get-dataflow-logs/{id}` routes.
- [x] Remove the matching mock service methods without touching DataFlow CRUD, relationships, task/script metadata, product lineage, or n8n Workflow generation.
- [x] Remove the independent task-manager MCP service and stale documentation references.
- [x] Verify `/api/datafactory/workflows*`, execution records, health check, generated n8n JSON, and order `onboard` remain referenced.

### Task 5: Make `app/` the Source of Truth and Clean Configuration/DDL

**Files:**
- Review and merge: the 12 differing files under `deployment/app/` into `app/`
- Modify: `app/config/config.py`
- Modify: `deployment/dataops.env`
- Modify: `docs/CODE_DOCUMENTATION.md`
- Delete: historical SQL files for calendar, WeChat, business cards, hotel brands, and hotel positions from `database/` and `deployment/database/`

- [x] Merge only still-valid DeepSeek, environment loading, timezone, logging, health-check, and production fixes into `app/`.
- [x] Remove Airflow configuration and Qwen generative fallback while leaving room for a separately scoped future Qwen Embedding client.
- [x] Keep core orders/products/review/version/task DDL and HOPMS assets/tests/results.
- [x] Regenerate `deployment/app/` and `deployment/database/` from source through the repository sync mechanism, then verify no reverse drift remains.

### Task 6: Upgrade the Frontend Runtime Baseline

**Files:**
- Modify: `frontend/package.json`
- Modify: lockfile produced by the selected package manager
- Add if useful: `frontend/.nvmrc`

- [x] Change the engine from Node 14 to Node 24 LTS.
- [x] Install dependencies and run the production build under Node 24.
- [x] Confirm Node 24 builds successfully; keep Vue 2 unchanged and record legacy dependency warnings for the next phase.
- [x] Do not perform Vue 3 migration in this cleanup.

### Task 7: Verify the Cleaned Baseline

**Files:**
- Update: `docs/2026-07-16_codebase_full_analysis_and_iteration_baseline.md`
- Update: this plan's checkboxes

- [x] Run the cleanup contract test and confirm all assertions pass.
- [x] Run Python syntax compilation and the available backend test suite in an isolated environment with requirements installed.
- [x] Run frontend production build and scan build output for missing modules.
- [x] Recount backend routes and frontend API calls; document before/after totals.
- [x] Run `rg` scans for Vanna, Airflow, removed routes, old data-factory calls, business-card APIs, and deleted components.
- [x] Review `git diff --check` and `git status --short`; confirm the pre-existing route edit and report remain preserved.
