Skip to content

feat: Add Mage orchestrator support#51

Merged
mingjerli merged 2 commits intomainfrom
feat/add-mage-orchestrator
Feb 3, 2026
Merged

feat: Add Mage orchestrator support#51
mingjerli merged 2 commits intomainfrom
feat/add-mage-orchestrator

Conversation

@mingjerli
Copy link
Owner

Summary

  • Add MageOrchestrator class that converts clgraph pipelines to Mage block-based pipelines (metadata.yaml + Python block files)
  • Update orchestrators/__init__.py to export MageOrchestrator
  • Add 27 integration tests in test_mage_integration.py covering block types, dependencies, configuration, and complex pipelines

Test plan

  • uv run pytest tests/test_mage_integration.py -v — 27 tests pass
  • uv run pytest tests/ -v — Full suite: 769 passed, 40 skipped
  • ruff check and ruff format pass

🤖 Generated with Claude Code

mingjerli and others added 2 commits February 2, 2026 03:19
Add MageOrchestrator class that converts clgraph pipelines to Mage
block-based pipelines with metadata.yaml and Python block files.
Includes 27 integration tests covering block types, dependencies,
configuration, and complex pipeline scenarios.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
- Remove unused `executor` parameter from all Mage methods
- Remove empty TYPE_CHECKING block
- Make database connector configurable via `db_connector` param
  (supports clickhouse, postgres, bigquery, snowflake)
- Fix mutation in to_pipeline_config() with immutable downstream_map
- Validate connection_name to prevent code injection
- Add tests for new connectors and input validation
@mingjerli mingjerli merged commit 84459ca into main Feb 3, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant