Página Principal Explorar Ajuda
Iniciar Sessão
mxl_citu
/
DataOps-platform
1
0
Fork 0
Ficheiros Problemas 0 Pull Requests 0 Wiki
Árvore: 7e80b618f6
Ramos Etiquetas
DataOps-plat...
/
docs
/
superpowers
/
plans
/
2026-07-16-codebase-cleanup.md

2026-07-16-codebase-cleanup.md 7.0 KB
Histórico Em bruto

DataOps Platform Codebase Cleanup Implementation Plan

For agentic workers: REQUIRED SUB-SKILL: Use superpowers:subagent-driven-development (recommended) or superpowers:executing-plans to implement this plan task-by-task. Steps use checkbox (- [x]) syntax for tracking.

Goal: Remove confirmed historical frontend/backend code while preserving n8n, DataFlow definition and lineage, data-security entry, governance knowledge-base entry, workbench, HOPMS tooling, and active governance/service/review flows.

Architecture: Treat frontend/src/router/routes.js and Flask Blueprint registration as reachability sources. Protect retained capabilities with a dependency-free cleanup contract test, remove legacy code in batches, make app/ the backend source of truth, and verify with static contracts, Python tests, frontend dependency installation, and a production build.

Tech Stack: Vue 2, Vue Router 3, Vuex, Flask, Python unittest/pytest, Node.js 24 LTS target with Node.js 22 LTS compatibility fallback, npm.

Task 1: Establish Recovery and Cleanup Contracts

Files:

  • Backup: /Users/maxiaolong/Documents/Codex/2026-07-06/g-i/DataOps-platform-backup-before-cleanup-20260716-170321.tar.gz

  • Create: tests/test_cleanup_contract.py

  • [x] Verify the backup contains .git, app/, frontend/, database/, and the analysis report; record its SHA-256.

  • [x] Add dependency-free unittest assertions that retained routes/files exist and confirmed legacy paths/routes/API strings do not exist.

  • [x] Run python3 -m unittest tests.test_cleanup_contract -v and confirm RED failures identify the current legacy code.

Task 2: Prune Frontend Routes and Historical Pages

Files:

  • Modify: frontend/src/router/routes.js
  • Modify: frontend/src/router/defaultRoute.js
  • Delete: frontend/src/views/dataChart/
  • Delete: frontend/src/views/modelSystem/
  • Delete: frontend/src/views/dataAsset/
  • Delete: frontend/src/views/dataDiagram/
  • Delete: frontend/src/views/questionnaireInquiry/
  • Delete: frontend/src/views/knowledgeBaseResume/
  • Delete: frontend/src/views/dataGovernance/dataResource/
  • Delete: frontend/src/views/dataGovernance/dataModules/
  • Delete: frontend/src/views/dataGovernance/dataIndicator/
  • Delete: frontend/src/views/dataBook/dataResource/
  • Delete: frontend/src/views/dataBook/dataModel/
  • Delete: frontend/src/views/dataBook/indicator/
  • Delete: old non-n8n directories under frontend/src/views/dataFactory/
  • Delete: old data-origin pages after confirming dataGovernance/dataSource has no component dependency on them

  • Delete: old system-management pages while retaining frontend/src/views/systemManage/error/404.vue

  • [x] Remove active and commented legacy route blocks; restore the Data Security route as a visible placeholder.

  • [x] Keep /home, /knowledge-base-product as the future governance knowledge-base entry, active governance/data-book pages, n8n production-line link, /dataFactory/workflow, data service, and data review.

  • [x] Remove /update from base routes and retain only the generic 404 component from system management.

  • [x] Scan retained components for imports of deleted views.

Task 3: Slim Frontend API and Shared Components

Files:

  • Replace: frontend/src/api/dataFactory.js with the ten n8n adapter calls only
  • Modify: frontend/src/api/dataGovernance.js
  • Modify: frontend/src/api/dataOrigin.js
  • Modify: retained shared data-book components that default to removed resource/model APIs
  • Delete: frontend/src/api/dataChart.js
  • Delete: frontend/src/api/chartCustomized.js
  • Delete: frontend/src/api/report.js
  • Delete: frontend/src/api/productionLine.js

  • Delete: obsolete API modules used only by removed system-management pages

  • [x] Remove Data Resource, Data Model, Data Indicator, Vanna training, and DataFlow execute/status/log client functions.

  • [x] Keep DataFlow list/detail/CRUD, business-domain list, and script retrieval.

  • [x] Remove business-card API functions while preserving /datasource/* functions.

  • [x] Make shared graph/info components require explicit APIs or use retained metadata/business-domain APIs.

  • [x] Scan all retained Vue/JS files for imports of deleted API exports.

Task 4: Remove Backend DataFlow Runtime and Obsolete Subsystems

Files:

  • Modify: app/api/data_flow/routes.py
  • Modify: app/core/data_flow/dataflows.py
  • Mirror generated deployment output only after app/ is correct

  • Delete: mcp-servers/task-manager/

  • [x] Remove /execute-dataflow/{id}, /get-dataflow-status/{id}, and /get-dataflow-logs/{id} routes.

  • [x] Remove the matching mock service methods without touching DataFlow CRUD, relationships, task/script metadata, product lineage, or n8n Workflow generation.

  • [x] Remove the independent task-manager MCP service and stale documentation references.

  • [x] Verify /api/datafactory/workflows*, execution records, health check, generated n8n JSON, and order onboard remain referenced.

Task 5: Make app/ the Source of Truth and Clean Configuration/DDL

Files:

  • Review and merge: the 12 differing files under deployment/app/ into app/
  • Modify: app/config/config.py
  • Modify: deployment/dataops.env
  • Modify: docs/CODE_DOCUMENTATION.md

  • Delete: historical SQL files for calendar, WeChat, business cards, hotel brands, and hotel positions from database/ and deployment/database/

  • [x] Merge only still-valid DeepSeek, environment loading, timezone, logging, health-check, and production fixes into app/.

  • [x] Remove Airflow configuration and Qwen generative fallback while leaving room for a separately scoped future Qwen Embedding client.

  • [x] Keep core orders/products/review/version/task DDL and HOPMS assets/tests/results.

  • [x] Regenerate deployment/app/ and deployment/database/ from source through the repository sync mechanism, then verify no reverse drift remains.

Task 6: Upgrade the Frontend Runtime Baseline

Files:

  • Modify: frontend/package.json
  • Modify: lockfile produced by the selected package manager

  • Add if useful: frontend/.nvmrc

  • [x] Change the engine from Node 14 to Node 24 LTS.

  • [x] Install dependencies and run the production build under Node 24.

  • [x] Confirm Node 24 builds successfully; keep Vue 2 unchanged and record legacy dependency warnings for the next phase.

  • [x] Do not perform Vue 3 migration in this cleanup.

Task 7: Verify the Cleaned Baseline

Files:

  • Update: docs/2026-07-16_codebase_full_analysis_and_iteration_baseline.md

  • Update: this plan's checkboxes

  • [x] Run the cleanup contract test and confirm all assertions pass.

  • [x] Run Python syntax compilation and the available backend test suite in an isolated environment with requirements installed.

  • [x] Run frontend production build and scan build output for missing modules.

  • [x] Recount backend routes and frontend API calls; document before/after totals.

  • [x] Run rg scans for Vanna, Airflow, removed routes, old data-factory calls, business-card APIs, and deleted components.

  • [x] Review git diff --check and git status --short; confirm the pre-existing route edit and report remain preserved.