Skip to content

Align pipelines show preview and add pipeline ID support to history - #6871

Open
chenyuem-db wants to merge 2 commits into
databricks:mainfrom
chenyuem-db:chenyuem-db/pipelines-public-api
Open

chenyuem-db wants to merge 2 commits into
databricks:mainfrom
chenyuem-db:chenyuem-db/pipelines-public-api

Conversation

@chenyuem-db

@chenyuem-db chenyuem-db commented Sep 28, 2026 •

Copy link
Copy Markdown

Changes

PRD: SDP Turbo CLI — Requirements

Implementation files below are relative to cmd/pipelines/.

databricks tables get FULL_NAME already uses the UC GetTable API and returns the full TableInfo including the schema. We don't need to add another pipelines schema cmd for this.

Command PRD requirement This PR Files
show P0: show the table name Added to text output. show.go
show P0: preview the first 5 rows by default Changed default from 10 to 5; row order remains unspecified. show.go
show P0: allow more rows with --limit n Existing override retained. show.go (existing path)
show P0: support JSON output for agents Existing JSON format retained. show.go (existing path)
show P1: hint how to see more rows Added when the default text preview returns 5 rows. show.go
show P2: show immediate upstream/external sources Not included. —
history Accept <pipeline id> Added direct-ID mode without requiring a bundle. history.go
history P0 output requirement: last 5 pipeline runs, if available Deferred: determine how a limit composes with existing start/end-time filters, and whether API or CLI should implement it. —
history P0 output requirement: metrics matching the UI Deferred pending public API support. Existing state/time output is unchanged. —
history Support --output json Existing Key / Updates format retained. history.go (existing path)

Supporting files:

  • Acceptance: new acceptance/pipelines/history/basic/; updated show fixtures/snapshots and command help.
  • Release note: .nextchanges/cli/pipelines-public-api.md.

Why

Keep history scoped to pipeline-ID support. Both ID and bundle modes retain the original pagination, time filters, output formats, and dry-run inclusion, returning all matching updates without a total limit. The API-versus-CLI decision for combining time filters with a default of 5 is left to follow-up work; utils.go and existing history unit tests are unchanged.

Tests

Pipelines unit tests, mock-API acceptance tests for history/show/help, Go lint, diff checks, and changelog validation passed locally.

Implementation assisted by Codex.

@chenyuem-db
chenyuem-db force-pushed the chenyuem-db/pipelines-public-api branch 4 times, most recently from 233ab54 to a645dce Compare September 29, 2026 03:04
Comment thread .nextchanges/cli/pipelines-public-api.md Outdated
@chenyuem-db
chenyuem-db force-pushed the chenyuem-db/pipelines-public-api branch from a645dce to 5537c36 Compare September 29, 2026 04:09
@chenyuem-db chenyuem-db changed the title Add pipeline schema and align preview and basic history commands Align pipeline preview and support pipeline IDs in history Sep 29, 2026
@github-actions

Copy link
Copy Markdown
Contributor

An authorized user can trigger integration tests manually by following the instructions below:

Trigger:
go/deco-tests-run/cli

Inputs:

  • PR number: 6871
  • Commit SHA: 5537c3675b62414ccb80bcfafae6d57286d893f9

Checks will be approved automatically on success.

@chenyuem-db chenyuem-db changed the title Align pipeline preview and support pipeline IDs in history Align pipelines show preview and add pipeline ID support to history Sep 29, 2026
@chenyuem-db
chenyuem-db marked this pull request as ready for review September 29, 2026 05:02

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant