Pipery Python CI#

Reusable GitHub Action for a complete Python CI pipeline with structured logging via Pipery.

GitHub Marketplace Version License: MIT

Table of Contents#

Quick Start#

name: CI
on: [push, pull_request]

jobs:
  ci:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      - uses: pipery-dev/python-ci@v1.1.0
        with:
          project_path: .
          pypi_token: ${{ secrets.PYPI_TOKEN }}
          github_token: ${{ secrets.GITHUB_TOKEN }}

Pipeline Overview#

StepToolSkip InputDescription
SASTBanditskip_sastDetects common Python security issues
SCApip-audit / safetyskip_scaIdentifies vulnerable dependencies
LintRuffskip_lintEnforces code style and quality
Buildpython build / poetry buildskip_buildPrepares distribution package
Testpytestskip_testRuns unit and integration tests
VersionSemantic versioningskip_versioningBumps version and creates git tag
Packagepython -m buildskip_packagingCreates wheel and sdist
Releasetwine PyPI publishskip_releasePublishes to PyPI
ReintegrateGit mergeskip_reintegrationMerges back to default branch

Configuration Options#

NameDefaultDescription
project_path.Path to the project source tree.
config_file.pipery/config.yamlPath to Pipery config file.
python_version3.11Python version to use (e.g., 3.9, 3.11, 3.12).
package_managerautoPackage manager: auto, setuptools, poetry, or uv.
tests_path``Path passed to pytest (directory, file, or node IDs).
registrypypiRegistry target for release.
version_bumppatchVersion bump type: patch, minor, or major.
pypi_token``PyPI API token for publishing.
github_token``GitHub token for reintegration.
target_branchmainTarget branch for reintegration.
log_filepipery.jsonlPath to the JSONL structured log file.
skip_sastfalseSkip the SAST step.
skip_scafalseSkip the SCA step.
skip_lintfalseSkip the lint step.
skip_buildfalseSkip the build step.
skip_testfalseSkip the test step.
skip_versioningfalseSkip the versioning step.
skip_packagingfalseSkip the packaging step.
skip_releasefalseSkip the release step.
skip_reintegrationfalseSkip the reintegration step.

Usage Examples#

Example 1: Standard setuptools project#

name: CI
on: [push, pull_request]

jobs:
  ci:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      - uses: pipery-dev/python-ci@v1.1.0
        with:
          project_path: .
          python_version: "3.11"
          pypi_token: ${{ secrets.PYPI_TOKEN }}
          github_token: ${{ secrets.GITHUB_TOKEN }}

Example 2: Poetry-based project#

- uses: pipery-dev/python-ci@v1.1.0
  with:
    project_path: .
    package_manager: poetry
    pypi_token: ${{ secrets.PYPI_TOKEN }}
    github_token: ${{ secrets.GITHUB_TOKEN }}

Example 3: Run specific test modules#

- uses: pipery-dev/python-ci@v1.1.0
  with:
    project_path: .
    tests_path: tests/unit tests/integration
    pypi_token: ${{ secrets.PYPI_TOKEN }}
    github_token: ${{ secrets.GITHUB_TOKEN }}

Example 4: Skip security checks for quick CI#

- uses: pipery-dev/python-ci@v1.1.0
  with:
    project_path: .
    skip_sast: true
    skip_sca: true
    skip_release: true

Example 5: Python 3.9 with uv package manager#

- uses: pipery-dev/python-ci@v1.1.0
  with:
    project_path: .
    python_version: "3.9"
    package_manager: uv
    pypi_token: ${{ secrets.PYPI_TOKEN }}
    github_token: ${{ secrets.GITHUB_TOKEN }}

Example 6: Minor version bump#

- uses: pipery-dev/python-ci@v1.1.0
  with:
    project_path: .
    version_bump: minor
    pypi_token: ${{ secrets.PYPI_TOKEN }}
    github_token: ${{ secrets.GITHUB_TOKEN }}

GitLab CI#

Use the GitLab mirror template when .gitlab-ci.yml is published for this pipeline family. Import it from the mirrored GitLab project or use it as a reference implementation for running the same Pipery pipeline outside GitHub Actions.

The GitLab pipeline maps action inputs to CI/CD variables, publishes pipery.jsonl as an artifact, and maintains the same skip controls. Store credentials as protected GitLab CI/CD variables.

include:
  - project: pipery-dev/python-ci
    ref: v1.1.0
    file: /.gitlab-ci.yml

GitLab CI Variables#

Configure these protected variables in Settings > CI/CD > Variables:

  • PYPI_TOKEN - PyPI authentication token
  • GITHUB_TOKEN - GitHub API access for reintegration
  • PYTHON_VERSION - Python version (default: 3.11)
  • PACKAGE_MANAGER - auto/setuptools/poetry/uv (default: auto)
  • VERSION_BUMP - patch/minor/major (default: patch)

Bitbucket Pipelines#

Bitbucket Cloud pipelines provide an alternative to GitHub Actions. Use Bitbucket shared pipeline imports to reference the exported Pipery pipeline instead of copying YAML into every application repository.

Getting Started#

  1. Add a Bitbucket import source for the shared Pipery pipeline and import the exported pipeline by name:
definitions:
  imports:
    pipery-shared: pipery-dev/python-ci:v1.1.0
    pipery-custom: pipery-dev/python-ci:v1.1.0:.bitbucket/shared-pipelines.yml

pipelines:
  branches:
    main:
      import: pipery-python-ci@pipery-shared

  custom:
    run-pipery:
      import: pipery-python-ci@pipery-custom

Use {project-path}/{repo-slug}:{branch-or-tag} for a shared repository bitbucket-pipelines.yml, or {project-path}/{repo-slug}:{branch-or-tag}:{config-filepath} for another exported YAML file.

  1. Configure Protected Variables in Repository Settings > Pipelines > Repository Variables:
    • PYPI_TOKEN - PyPI authentication token
    • GITHUB_TOKEN - GitHub API access (for reintegration)
    • PYTHON_VERSION - Python version (default: 3.11)
  2. Commit and push to trigger the pipeline

Pipeline Stages#

The Bitbucket equivalent follows the same structure:

checkout → setup → SAST (Bandit, parallel) → SCA (pip-audit, parallel) → lint (Ruff) → build → test → versioning → packaging → release → reintegration → logs

Skip Flags#

Disable any stage using environment variables:

  • SKIP_SAST, SKIP_SCA, SKIP_LINT, SKIP_BUILD, SKIP_TEST, SKIP_VERSIONING, SKIP_PACKAGING, SKIP_RELEASE, SKIP_REINTEGRATION

Example: Set SKIP_LINT=true to skip linting.

Features#

  • Same security scanning tools (Bandit, pip-audit, safety)
  • Parallel SAST and SCA stages
  • Support for setuptools, Poetry, and uv
  • Automatic versioning and tagging
  • PyPI publish with token authentication
  • JSONL-based pipeline logging
  • 30-90 day artifact retention

About Pipery#

Pipery Pipery is an open-source CI/CD observability platform. Every step script runs under psh (Pipery Shell), which intercepts all commands and emits structured JSONL events — giving you full visibility into your pipeline without any manual instrumentation.

Development#

# Run the action locally against test-project/
pipery-actions test --repo .

# Regenerate docs
pipery-actions docs --repo .

# Dry-run release
pipery-actions release --repo . --dry-run