Cloud-Plattformen · 31.08.2026, 16:18 UTC
From weeks to minutes: The new agentic era of data pipelines
| Schweregrad | info |
|---|---|
| Kategorie | Cloud-Plattformen |
| Quelle | Google Cloud Blog ↗ |
| Veröffentlicht | 31.08.2026 UTC |
Sicherheitsmeldung mit Schweregrad noch nicht bewertet. Technische Details im Tab „Originaltext“; empfohlene Schritte in der Checkliste.
Data pipelines are the backbone of the modern enterprise, yet a barrier to entry exists for orchestrating them, making this critical capability unavailable to many data professionals. Following our announcements at Google Cloud NEXT ’26, where we introduced the Orchestration Pipelines framework, we are fundamentally changing this dynamic. To bring this powerful framework directly to practitioners, we offer the Data Agent Kit — a unified, freely available, and open-source collection of data engineering and data science tools that integrate directly into your preferred IDE or CLI (such as VS Code, Claude Code, or Codex). The Data Agent Kit seamlessly embeds the Orchestration Pipelines framework into your workflow in two distinct ways. First, it provides a dedicated Data Engineering tab for comprehensive pipeline management. Second, it includes a specialized agentic skill designed to author, deploy, and troubleshoot production-grade Apache Airflow® DAGs using natural language. By pairing these specialized agent skills with a declarative YAML DSL, all data personas — from analysts to ML engineers — can bypass complex Python Airflow boilerplate. This framework decouples high-level orchestration logic from underlying compute execution, democratizing access to powerful MLOps capabilities across your entire data organization. In this post, we will walk through an exemplary MLOps use case to demonstrate how easily this can be achieved. Setting up your environment Before authoring your first Orchestration Pipeline, you need to set up your local development environment. Getting …
Maßnahmen
⬇ Als MarkdownVerwandte Beiträge
- info Amazon EMR on EKS now supports job run concurrency controls
- info Amazon OpenSearch Service adds new Cluster Insights for faster diagnosis of cluster status
- info What’s new in AI infrastructure and orchestration in August
- info BigQuery Graph is now GA: the knowledge foundation for the agentic era